[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:28 dist-test-slave-68xk krb5kdc[22375](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:28 dist-test-slave-68xk krb5kdc[22375](info): set up 2 sockets
Aug 09 02:25:28 dist-test-slave-68xk krb5kdc[22375](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 02:25:29.665338 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.353s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:25:29 dist-test-slave-68xk krb5kdc[22375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:25:29.802582 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:41059
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:41059
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:29.915408 22394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:29.915712 22394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:29.915786 22394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:29.919839 22394 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:29.919921 22394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:29.919960 22394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:29.920018 22394 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:29.920058 22394 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:29.925303 22394 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:41059
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:41059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:29.926398 22394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:29.927501 22394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:25:29.936997 22394 server_base.cc:1034] running on GCE node
W20260809 02:25:29.937006 22405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:29.937017 22400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:29.937008 22401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:29.937959 22394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:29.939234 22394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:29.940452 22394 hybrid_clock.cc:648] HybridClock initialized: now 1786242329940407 us; error 60 us; skew 500 ppm
Aug 09 02:25:29 dist-test-slave-68xk krb5kdc[22375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242329, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:29.949596 22394 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:25:29.950752 22394 webserver.cc:460] Webserver started at http://127.21.214.190:34403/ using document root <none> and password file <none>
I20260809 02:25:29.951409 22394 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:29.951483 22394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:29.951740 22394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:29.954140 22394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "189ee9a3caba4d3287fd37e8b46ca158"
format_stamp: "Formatted at 2026-08-09 02:25:29 on dist-test-slave-68xk"
server_key: "e8c47f2f8ab3ea3dc7dcd105e915f0d3"
server_key_iv: "444df726064f632e05efa818e8bf29f9"
server_key_version: "encryptionkey@0"
I20260809 02:25:29.954881 22394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "189ee9a3caba4d3287fd37e8b46ca158"
format_stamp: "Formatted at 2026-08-09 02:25:29 on dist-test-slave-68xk"
server_key: "e8c47f2f8ab3ea3dc7dcd105e915f0d3"
server_key_iv: "444df726064f632e05efa818e8bf29f9"
server_key_version: "encryptionkey@0"
I20260809 02:25:29.959213 22394 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:25:29.961939 22416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:29.963429 22394 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:25:29.963609 22394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "189ee9a3caba4d3287fd37e8b46ca158"
format_stamp: "Formatted at 2026-08-09 02:25:29 on dist-test-slave-68xk"
server_key: "e8c47f2f8ab3ea3dc7dcd105e915f0d3"
server_key_iv: "444df726064f632e05efa818e8bf29f9"
server_key_version: "encryptionkey@0"
I20260809 02:25:29.963752 22394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:29.982275 22394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:29.986042 22394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:29.986276 22394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:29.994501 22394 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:41059
I20260809 02:25:29.994541 22496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:41059 every 8 connection(s)
I20260809 02:25:29.995539 22394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:29.998370 22500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:30.000480 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 22394
I20260809 02:25:30.000660 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:30.002171 22362 external_mini_cluster.cc:1428] Setting key c2ee5505a099c017edf6fb2fc33fdaf9
I20260809 02:25:30.004485 22500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158: Bootstrap starting.
I20260809 02:25:30.007201 22500 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:30.008070 22500 log.cc:824] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:30.010094 22500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158: No bootstrap required, opened a new log
I20260809 02:25:30.014952 22500 raft_consensus.cc:348] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189ee9a3caba4d3287fd37e8b46ca158" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 41059 } }
I20260809 02:25:30.015218 22500 raft_consensus.cc:374] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:30.015318 22500 raft_consensus.cc:729] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 189ee9a3caba4d3287fd37e8b46ca158, State: Initialized, Role: FOLLOWER
I20260809 02:25:30.015772 22500 consensus_queue.cc:260] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189ee9a3caba4d3287fd37e8b46ca158" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 41059 } }
I20260809 02:25:30.015923 22500 raft_consensus.cc:388] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:30.016013 22500 raft_consensus.cc:482] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:30.016144 22500 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:30.017405 22500 raft_consensus.cc:504] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189ee9a3caba4d3287fd37e8b46ca158" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 41059 } }
I20260809 02:25:30.017769 22500 leader_election.cc:302] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 189ee9a3caba4d3287fd37e8b46ca158; no voters:
I20260809 02:25:30.018110 22500 leader_election.cc:288] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:30.018277 22508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:30.018564 22508 raft_consensus.cc:686] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [term 1 LEADER]: Becoming Leader. State: Replica: 189ee9a3caba4d3287fd37e8b46ca158, State: Running, Role: LEADER
I20260809 02:25:30.018927 22508 consensus_queue.cc:237] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189ee9a3caba4d3287fd37e8b46ca158" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 41059 } }
I20260809 02:25:30.019503 22500 sys_catalog.cc:564] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:30.020501 22511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 189ee9a3caba4d3287fd37e8b46ca158. Latest consensus state: current_term: 1 leader_uuid: "189ee9a3caba4d3287fd37e8b46ca158" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189ee9a3caba4d3287fd37e8b46ca158" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 41059 } } }
I20260809 02:25:30.020637 22511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:30.020944 22510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "189ee9a3caba4d3287fd37e8b46ca158" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "189ee9a3caba4d3287fd37e8b46ca158" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 41059 } } }
I20260809 02:25:30.021032 22510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:30.021386 22520 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:30.024775 22520 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[22375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:30.030946 22520 catalog_manager.cc:1347] Generated new cluster ID: e4c74ffbb25c45739481905335147049
I20260809 02:25:30.031004 22520 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:30.032923 22502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:30.006023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50632 (local address 127.21.214.190:41059)
0809 02:25:30.006632 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:30.006654 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:30.007850 (+ 1196us) server_negotiation.cc:407] Connection header received
0809 02:25:30.012618 (+ 4768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:30.012642 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:30.013084 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:30.013476 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:30.016496 (+ 3020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.018003 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.019902 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.020688 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.020885 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:30.026741 (+ 5856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:30.026748 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:30.026764 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:30.026800 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:30.028744 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:30.029386 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:30.029393 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:30.029399 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:30.029547 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:30.029967 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:30.029971 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:30.029973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:30.030700 (+ 727us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:30.030999 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:30.031646 (+ 647us) server_negotiation.cc:299] Negotiation successful
0809 02:25:30.031966 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":202,"threads_started":1}
I20260809 02:25:30.039737 22520 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:30.040874 22520 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:30.055804 22520 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 189ee9a3caba4d3287fd37e8b46ca158: Generated new TSK 0
I20260809 02:25:30.056571 22520 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:25:30.093338 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:41059
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:30.211546 22536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:30.211839 22536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:30.211921 22536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:30.215965 22536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:30.216043 22536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:30.216146 22536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:25:30.221767 22536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:41059
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:30.222858 22536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:30.223873 22536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:30.233675 22547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:30.233764 22551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:30.233893 22536 server_base.cc:1034] running on GCE node
W20260809 02:25:30.233673 22555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:30.234544 22536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:30.235185 22536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:30.236382 22536 hybrid_clock.cc:648] HybridClock initialized: now 1786242330236365 us; error 30 us; skew 500 ppm
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[22375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242330, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:30.239300 22536 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:25:30.240322 22536 webserver.cc:460] Webserver started at http://127.21.214.129:36687/ using document root <none> and password file <none>
I20260809 02:25:30.240949 22536 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:30.241063 22536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:30.241336 22536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:30.243594 22536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "042828ef4f2248cdafb8e94858a0086e"
format_stamp: "Formatted at 2026-08-09 02:25:30 on dist-test-slave-68xk"
server_key: "51a8353a710588c4cb08f4e23ef56ad2"
server_key_iv: "5478c37273922d555ae3b1080ee24f60"
server_key_version: "encryptionkey@0"
I20260809 02:25:30.244220 22536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "042828ef4f2248cdafb8e94858a0086e"
format_stamp: "Formatted at 2026-08-09 02:25:30 on dist-test-slave-68xk"
server_key: "51a8353a710588c4cb08f4e23ef56ad2"
server_key_iv: "5478c37273922d555ae3b1080ee24f60"
server_key_version: "encryptionkey@0"
I20260809 02:25:30.248194 22536 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:25:30.250592 22566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:30.251715 22536 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:30.251852 22536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "042828ef4f2248cdafb8e94858a0086e"
format_stamp: "Formatted at 2026-08-09 02:25:30 on dist-test-slave-68xk"
server_key: "51a8353a710588c4cb08f4e23ef56ad2"
server_key_iv: "5478c37273922d555ae3b1080ee24f60"
server_key_version: "encryptionkey@0"
I20260809 02:25:30.251961 22536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:30.260391 22536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:30.262972 22536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:30.263171 22536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:30.263710 22536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:30.264479 22536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:30.264550 22536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:30.264611 22536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:30.264654 22536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:30.273957 22536 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:42089
I20260809 02:25:30.273994 22739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:42089 every 8 connection(s)
I20260809 02:25:30.274892 22536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:25:30.280697 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 22536
I20260809 02:25:30.280807 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:25:30.281086 22362 external_mini_cluster.cc:1428] Setting key 7b821f105b2fa2eee122dec814df40f8
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[22375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242330, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:30.289498 22502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:30.276685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:38935 (local address 127.21.214.190:41059)
0809 02:25:30.276828 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:30.276831 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:30.277760 (+ 929us) server_negotiation.cc:407] Connection header received
0809 02:25:30.279217 (+ 1457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:30.279220 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:30.279269 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:30.279345 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:30.280526 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.281336 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.282700 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.283019 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.283139 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:30.285575 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:30.285580 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:30.285585 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:30.285615 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:30.287158 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:30.287893 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:30.287896 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:30.287897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:30.287969 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:30.288363 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:30.288366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:30.288367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:30.288529 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:30.288606 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:30.289269 (+ 663us) server_negotiation.cc:299] Negotiation successful
0809 02:25:30.289371 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:25:30.290714 22746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:30.277020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:41059 (local address 127.21.214.129:38935)
0809 02:25:30.277571 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:30.277626 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:30.279011 (+ 1385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:30.279507 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:30.279513 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:30.279862 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:30.280326 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:30.280361 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.281468 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.281471 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:30.282530 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:30.282541 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.283165 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.283168 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:30.283313 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:30.283919 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:30.283935 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:30.285405 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:30.287279 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:30.287288 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:30.287306 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:30.287728 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:30.288068 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:30.288073 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:30.288076 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:30.288267 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:30.288644 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:30.288652 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:30.289000 (+ 348us) client_negotiation.cc:769] Sending connection context
0809 02:25:30.289236 (+ 236us) client_negotiation.cc:240] Negotiation successful
0809 02:25:30.289609 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":119,"threads_started":1}
I20260809 02:25:30.292073 22740 heartbeater.cc:347] Connected to a master server at 127.21.214.190:41059
I20260809 02:25:30.292323 22740 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:25:30.292863 22740 heartbeater.cc:511] Master 127.21.214.190:41059 requested a full tablet report, sending...
I20260809 02:25:30.294603 22444 ts_manager.cc:194] Registered new tserver with Master: 042828ef4f2248cdafb8e94858a0086e (127.21.214.129:42089)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
I20260809 02:25:30.296206 22444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:38935
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:25:30.313400 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:41059
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:30.429093 22759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:30.429337 22759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:30.429425 22759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:30.433586 22759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:30.433642 22759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:30.433699 22759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:25:30.438788 22759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:41059
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:30.439766 22759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:30.440739 22759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:30.450560 22771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:30.450583 22769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:30.450695 22759 server_base.cc:1034] running on GCE node
W20260809 02:25:30.450596 22768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:30.451259 22759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:30.451973 22759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:30.453173 22759 hybrid_clock.cc:648] HybridClock initialized: now 1786242330453143 us; error 40 us; skew 500 ppm
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[22375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242330, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:30.456090 22759 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:25:30.456869 22759 webserver.cc:460] Webserver started at http://127.21.214.130:46497/ using document root <none> and password file <none>
I20260809 02:25:30.457381 22759 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:30.457437 22759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:30.457599 22759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:30.459647 22759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "887177e616634890abf91d62d3b5b8d8"
format_stamp: "Formatted at 2026-08-09 02:25:30 on dist-test-slave-68xk"
server_key: "bdd04f4ba8e3ffbe8227581c852144f2"
server_key_iv: "4d8a776312badd4779a6403d8cbf4264"
server_key_version: "encryptionkey@0"
I20260809 02:25:30.460151 22759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "887177e616634890abf91d62d3b5b8d8"
format_stamp: "Formatted at 2026-08-09 02:25:30 on dist-test-slave-68xk"
server_key: "bdd04f4ba8e3ffbe8227581c852144f2"
server_key_iv: "4d8a776312badd4779a6403d8cbf4264"
server_key_version: "encryptionkey@0"
I20260809 02:25:30.463730 22759 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:25:30.466032 22783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:30.467315 22759 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:30.467411 22759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "887177e616634890abf91d62d3b5b8d8"
format_stamp: "Formatted at 2026-08-09 02:25:30 on dist-test-slave-68xk"
server_key: "bdd04f4ba8e3ffbe8227581c852144f2"
server_key_iv: "4d8a776312badd4779a6403d8cbf4264"
server_key_version: "encryptionkey@0"
I20260809 02:25:30.467492 22759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:30.487499 22759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:30.490764 22759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:30.490914 22759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:30.491420 22759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:30.492187 22759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:30.492235 22759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:30.492277 22759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:30.492295 22759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:30.501648 22759 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:46699
I20260809 02:25:30.501684 22968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:46699 every 8 connection(s)
I20260809 02:25:30.502578 22759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:25:30.509999 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 22759
I20260809 02:25:30.510093 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:25:30.510480 22362 external_mini_cluster.cc:1428] Setting key 97fa656182c9d594a80d7236af0b6ed8
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[22375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242330, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:30.517014 22502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:30.504345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:44649 (local address 127.21.214.190:41059)
0809 02:25:30.504488 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:30.504492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:30.505440 (+ 948us) server_negotiation.cc:407] Connection header received
0809 02:25:30.506249 (+ 809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:30.506252 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:30.506301 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:30.506375 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:30.507510 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.508052 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.509335 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.509546 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.509625 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:30.512681 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:30.512687 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:30.512693 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:30.512728 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:30.514634 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:30.515345 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:30.515348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:30.515349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:30.515423 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:30.515872 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:30.515874 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:30.515875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:30.516057 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:30.516130 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:30.516802 (+ 672us) server_negotiation.cc:299] Negotiation successful
0809 02:25:30.516898 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:25:30.518435 22973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:30.504628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:41059 (local address 127.21.214.130:44649)
0809 02:25:30.505282 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:30.505325 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:30.506074 (+ 749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:30.506560 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:30.506567 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:30.506924 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:30.507376 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:30.507388 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.508203 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.508206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:30.509205 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:30.509215 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.509695 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.509698 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:30.509873 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:30.510609 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:30.510630 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:30.512508 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:30.514758 (+ 2250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:30.514767 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:30.514787 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:30.515238 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:30.515523 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:30.515526 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:30.515530 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:30.515747 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:30.516178 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:30.516188 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:30.516531 (+ 343us) client_negotiation.cc:769] Sending connection context
0809 02:25:30.516766 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 02:25:30.517168 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":112,"threads_started":1}
I20260809 02:25:30.519721 22970 heartbeater.cc:347] Connected to a master server at 127.21.214.190:41059
I20260809 02:25:30.520016 22970 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:30.520617 22970 heartbeater.cc:511] Master 127.21.214.190:41059 requested a full tablet report, sending...
I20260809 02:25:30.521683 22444 ts_manager.cc:194] Registered new tserver with Master: 887177e616634890abf91d62d3b5b8d8 (127.21.214.130:46699)
I20260809 02:25:30.522240 22444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:44649
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:25:30.541757 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:41059
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:30.655705 22976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:30.655987 22976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:30.656061 22976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:30.660193 22976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:30.660288 22976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:30.660380 22976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:25:30.665503 22976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:41059
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:30.666574 22976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:30.667680 22976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:30.677919 22985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:30.677959 22990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:30.677959 22986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:30.678158 22976 server_base.cc:1034] running on GCE node
I20260809 02:25:30.678654 22976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:30.679351 22976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:30.680548 22976 hybrid_clock.cc:648] HybridClock initialized: now 1786242330680531 us; error 32 us; skew 500 ppm
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[22375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242330, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:30.683495 22976 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:25:30.684441 22976 webserver.cc:460] Webserver started at http://127.21.214.131:39387/ using document root <none> and password file <none>
I20260809 02:25:30.685051 22976 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:30.685150 22976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:30.685392 22976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:30.687592 22976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "079bae4a569243df926676f5ef2e96b2"
format_stamp: "Formatted at 2026-08-09 02:25:30 on dist-test-slave-68xk"
server_key: "10ee8be4f15b90ff1549b6c1d7033eec"
server_key_iv: "81443bef2f5f49ea2cd271e006858f45"
server_key_version: "encryptionkey@0"
I20260809 02:25:30.688179 22976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "079bae4a569243df926676f5ef2e96b2"
format_stamp: "Formatted at 2026-08-09 02:25:30 on dist-test-slave-68xk"
server_key: "10ee8be4f15b90ff1549b6c1d7033eec"
server_key_iv: "81443bef2f5f49ea2cd271e006858f45"
server_key_version: "encryptionkey@0"
I20260809 02:25:30.692112 22976 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:25:30.694597 22999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:30.695791 22976 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:30.695933 22976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "079bae4a569243df926676f5ef2e96b2"
format_stamp: "Formatted at 2026-08-09 02:25:30 on dist-test-slave-68xk"
server_key: "10ee8be4f15b90ff1549b6c1d7033eec"
server_key_iv: "81443bef2f5f49ea2cd271e006858f45"
server_key_version: "encryptionkey@0"
I20260809 02:25:30.696050 22976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:30.711874 22976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:30.714808 22976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:30.715014 22976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:30.715622 22976 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:30.716559 22976 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:30.716635 22976 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:30.716709 22976 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:30.716770 22976 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:30.728878 22976 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:46831
I20260809 02:25:30.728900 23184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:46831 every 8 connection(s)
I20260809 02:25:30.729790 22976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:25:30.738462 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 22976
I20260809 02:25:30.738598 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:25:30.738885 22362 external_mini_cluster.cc:1428] Setting key 3ac4a1cedb71bad53f639cebfd2914c6
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[22375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242330, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:30.744221 22502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:30.731743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:39815 (local address 127.21.214.190:41059)
0809 02:25:30.731885 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:30.731889 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:30.732718 (+ 829us) server_negotiation.cc:407] Connection header received
0809 02:25:30.734080 (+ 1362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:30.734084 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:30.734143 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:30.734223 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:30.735461 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.736000 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.737177 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.737413 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.737525 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:30.740403 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:30.740407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:30.740410 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:30.740438 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:30.741914 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:30.742454 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:30.742459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:30.742461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:30.742548 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:30.743043 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:30.743049 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:30.743051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:30.743265 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:30.743386 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:30.743919 (+ 533us) server_negotiation.cc:299] Negotiation successful
0809 02:25:30.744042 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:25:30.745002 23188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:30.732102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:41059 (local address 127.21.214.131:39815)
0809 02:25:30.732567 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:30.732611 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:30.733871 (+ 1260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:30.734391 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:30.734398 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:30.734831 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:30.735313 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:30.735327 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.736161 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.736164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:30.737039 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:30.737049 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.737572 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.737576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:30.737741 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:30.738352 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:30.738368 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:30.740241 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:30.742033 (+ 1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:30.742039 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:30.742053 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:30.742324 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:30.742646 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:30.742649 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:30.742652 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:30.742849 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:30.743386 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:30.743394 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:30.743672 (+ 278us) client_negotiation.cc:769] Sending connection context
0809 02:25:30.743873 (+ 201us) client_negotiation.cc:240] Negotiation successful
0809 02:25:30.744196 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":117,"threads_started":1}
I20260809 02:25:30.746079 23185 heartbeater.cc:347] Connected to a master server at 127.21.214.190:41059
I20260809 02:25:30.746330 23185 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:30.746850 23185 heartbeater.cc:511] Master 127.21.214.190:41059 requested a full tablet report, sending...
I20260809 02:25:30.747932 22444 ts_manager.cc:194] Registered new tserver with Master: 079bae4a569243df926676f5ef2e96b2 (127.21.214.131:46831)
I20260809 02:25:30.748528 22444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:39815
I20260809 02:25:30.753279 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[22375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242330, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[22375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242330, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.214.129@KRBTEST.COM
I20260809 02:25:30.782124 23196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:30.772546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55634 (local address 127.21.214.129:42089)
0809 02:25:30.772938 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:30.772956 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:30.772983 (+ 27us) server_negotiation.cc:407] Connection header received
0809 02:25:30.773179 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:30.773185 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:30.773381 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:30.773538 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:30.774260 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.775110 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.776005 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.776375 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.776466 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:30.778913 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:30.778922 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:30.778933 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:30.778956 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:30.780426 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:30.780884 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:30.780889 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:30.780890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:30.780972 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:30.781245 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:30.781247 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:30.781249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:30.781480 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:30.781640 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:30.781833 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 02:25:30.781963 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":72,"threads_started":1}
W20260809 02:25:30.783143 22611 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55634
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[22375](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[22375](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242330, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.129@KRBTEST.COM
I20260809 02:25:30.810388 23196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:30.801911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55644 (local address 127.21.214.129:42089)
0809 02:25:30.802078 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:30.802083 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:30.802211 (+ 128us) server_negotiation.cc:407] Connection header received
0809 02:25:30.802402 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:30.802406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:30.802499 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:30.802585 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:30.803261 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.803791 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.804622 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:30.804873 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:30.804983 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:30.807445 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:30.807449 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:30.807450 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:30.807474 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:30.808850 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:30.809227 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:30.809230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:30.809231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:30.809355 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:30.809600 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:30.809602 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:30.809604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:30.809765 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:30.809874 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:30.810150 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 02:25:30.810259 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 02:25:30.811650 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 22536
I20260809 02:25:30.828693 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 22759
I20260809 02:25:30.845468 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 22976
I20260809 02:25:30.854489 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 22394
2026-08-09T02:25:30Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2580 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[23206](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[23206](info): set up 2 sockets
Aug 09 02:25:30 dist-test-slave-68xk krb5kdc[23206](info): commencing operation
krb5kdc: starting...
W20260809 02:25:32.164790 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:25:32 dist-test-slave-68xk krb5kdc[23206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:25:32.298239 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:37967
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:37967
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:32.414032 23231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:32.414386 23231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:32.414467 23231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:32.418349 23231 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:32.418396 23231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:32.418437 23231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:32.418453 23231 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:32.418468 23231 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:32.423591 23231 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:37967
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:37967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:32.424645 23231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:32.425640 23231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:32.434337 23240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:32.434342 23244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:32.434360 23241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:32.434715 23231 server_base.cc:1034] running on GCE node
I20260809 02:25:32.435461 23231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:32.436527 23231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:32.437718 23231 hybrid_clock.cc:648] HybridClock initialized: now 1786242332437697 us; error 37 us; skew 500 ppm
Aug 09 02:25:32 dist-test-slave-68xk krb5kdc[23206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242332, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:32.440995 23231 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:25:32.441999 23231 webserver.cc:460] Webserver started at http://127.21.214.190:33499/ using document root <none> and password file <none>
I20260809 02:25:32.442673 23231 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:32.442771 23231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:32.443014 23231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:32.445185 23231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "8e636ebc15784c6f8ec75d1d287475cc"
format_stamp: "Formatted at 2026-08-09 02:25:32 on dist-test-slave-68xk"
server_key: "2037513ac02786d8393afd38be7c5be2"
server_key_iv: "27c9c2057efc61e07e1864c145112648"
server_key_version: "encryptionkey@0"
I20260809 02:25:32.445784 23231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "8e636ebc15784c6f8ec75d1d287475cc"
format_stamp: "Formatted at 2026-08-09 02:25:32 on dist-test-slave-68xk"
server_key: "2037513ac02786d8393afd38be7c5be2"
server_key_iv: "27c9c2057efc61e07e1864c145112648"
server_key_version: "encryptionkey@0"
I20260809 02:25:32.449709 23231 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 02:25:32.452283 23254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:32.453557 23231 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:25:32.453703 23231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "8e636ebc15784c6f8ec75d1d287475cc"
format_stamp: "Formatted at 2026-08-09 02:25:32 on dist-test-slave-68xk"
server_key: "2037513ac02786d8393afd38be7c5be2"
server_key_iv: "27c9c2057efc61e07e1864c145112648"
server_key_version: "encryptionkey@0"
I20260809 02:25:32.453819 23231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:32.464603 23231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:32.467649 23231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:32.467872 23231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:32.476436 23231 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:37967
I20260809 02:25:32.476467 23347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:37967 every 8 connection(s)
I20260809 02:25:32.477485 23231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:32.480430 23349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:32.485714 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 23231
I20260809 02:25:32.485859 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:32.486171 22362 external_mini_cluster.cc:1428] Setting key 0a1d7b10ea0dacf21310d712945671c8
I20260809 02:25:32.487218 23349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc: Bootstrap starting.
I20260809 02:25:32.489931 23349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:32.490856 23349 log.cc:824] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:32.492908 23349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc: No bootstrap required, opened a new log
Aug 09 02:25:32 dist-test-slave-68xk krb5kdc[23206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:32.497853 23349 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e636ebc15784c6f8ec75d1d287475cc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37967 } }
I20260809 02:25:32.498126 23349 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:32.498217 23349 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e636ebc15784c6f8ec75d1d287475cc, State: Initialized, Role: FOLLOWER
I20260809 02:25:32.498760 23349 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e636ebc15784c6f8ec75d1d287475cc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37967 } }
I20260809 02:25:32.498898 23349 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:32.498991 23349 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:32.499099 23349 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:32.500063 23349 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e636ebc15784c6f8ec75d1d287475cc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37967 } }
I20260809 02:25:32.500439 23349 leader_election.cc:302] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e636ebc15784c6f8ec75d1d287475cc; no voters:
I20260809 02:25:32.500777 23349 leader_election.cc:288] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:32.500919 23356 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:32.501178 23356 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [term 1 LEADER]: Becoming Leader. State: Replica: 8e636ebc15784c6f8ec75d1d287475cc, State: Running, Role: LEADER
I20260809 02:25:32.501591 23356 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e636ebc15784c6f8ec75d1d287475cc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37967 } }
I20260809 02:25:32.502279 23349 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:32.503372 23353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:32.487858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52992 (local address 127.21.214.190:37967)
0809 02:25:32.488380 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:32.488397 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:32.488437 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:25:32.489210 (+ 773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:32.489229 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:32.489592 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:32.489980 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:32.490965 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:32.492099 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:32.493088 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:32.493670 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:32.493887 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:32.497044 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:32.497049 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:32.497108 (+ 59us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:32.497139 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:32.499423 (+ 2284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:32.499917 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:32.499924 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:32.499930 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:32.500066 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:32.500399 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:32.500403 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:32.500405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:32.500988 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:32.501294 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:32.501940 (+ 646us) server_negotiation.cc:299] Negotiation successful
0809 02:25:32.502259 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":152,"threads_started":1}
I20260809 02:25:32.503602 23358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e636ebc15784c6f8ec75d1d287475cc. Latest consensus state: current_term: 1 leader_uuid: "8e636ebc15784c6f8ec75d1d287475cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e636ebc15784c6f8ec75d1d287475cc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37967 } } }
I20260809 02:25:32.503758 23358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:32.503602 23357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e636ebc15784c6f8ec75d1d287475cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e636ebc15784c6f8ec75d1d287475cc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37967 } } }
I20260809 02:25:32.503914 23357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:32.504354 23371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:32.507789 23371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:32.513906 23371 catalog_manager.cc:1347] Generated new cluster ID: 66024dd5eb3342cbbb2e7a8fc704f5a2
I20260809 02:25:32.513995 23371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:32.527608 23371 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:32.528647 23371 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:32.543593 23371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e636ebc15784c6f8ec75d1d287475cc: Generated new TSK 0
I20260809 02:25:32.544356 23371 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:25:32.575591 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:37967
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:32.692668 23391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:32.692929 23391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:32.692974 23391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:32.696967 23391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:32.697027 23391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:32.697084 23391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:25:32.702378 23391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:37967
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:32.703426 23391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:32.704486 23391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:32.714336 23398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:32.714383 23397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:32.714336 23403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:32.714646 23391 server_base.cc:1034] running on GCE node
I20260809 02:25:32.715080 23391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:32.715724 23391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:32.716892 23391 hybrid_clock.cc:648] HybridClock initialized: now 1786242332716858 us; error 47 us; skew 500 ppm
Aug 09 02:25:32 dist-test-slave-68xk krb5kdc[23206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242332, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:32.720073 23391 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:25:32.720968 23391 webserver.cc:460] Webserver started at http://127.21.214.129:36585/ using document root <none> and password file <none>
I20260809 02:25:32.721558 23391 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:32.721655 23391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:32.721901 23391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:32.724153 23391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "b9a3e31e15b24355816f043be4199f59"
format_stamp: "Formatted at 2026-08-09 02:25:32 on dist-test-slave-68xk"
server_key: "43f3cdce627f25281a3dd5d49fc6f6b4"
server_key_iv: "71b30268f5b9aaaefaa368101a05011e"
server_key_version: "encryptionkey@0"
I20260809 02:25:32.724727 23391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "b9a3e31e15b24355816f043be4199f59"
format_stamp: "Formatted at 2026-08-09 02:25:32 on dist-test-slave-68xk"
server_key: "43f3cdce627f25281a3dd5d49fc6f6b4"
server_key_iv: "71b30268f5b9aaaefaa368101a05011e"
server_key_version: "encryptionkey@0"
I20260809 02:25:32.728611 23391 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:25:32.731182 23416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:32.732427 23391 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:32.732579 23391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "b9a3e31e15b24355816f043be4199f59"
format_stamp: "Formatted at 2026-08-09 02:25:32 on dist-test-slave-68xk"
server_key: "43f3cdce627f25281a3dd5d49fc6f6b4"
server_key_iv: "71b30268f5b9aaaefaa368101a05011e"
server_key_version: "encryptionkey@0"
I20260809 02:25:32.732695 23391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:32.754232 23391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:32.757874 23391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:32.758162 23391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:32.758908 23391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:32.759753 23391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:32.759811 23391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:32.759852 23391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:32.759867 23391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:32.769697 23391 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:36403
I20260809 02:25:32.769728 23588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:36403 every 8 connection(s)
I20260809 02:25:32.770684 23391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:25:32.773046 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 23391
I20260809 02:25:32.773168 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:25:32.773504 22362 external_mini_cluster.cc:1428] Setting key 69d9e7e448550f023017fffeb5ecdc9e
Aug 09 02:25:32 dist-test-slave-68xk krb5kdc[23206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242332, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:25:32.787091 23353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:32.772690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:34849 (local address 127.21.214.190:37967)
0809 02:25:32.772907 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:32.772912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:32.773863 (+ 951us) server_negotiation.cc:407] Connection header received
0809 02:25:32.775512 (+ 1649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:32.775516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:32.775578 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:32.775671 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:32.777057 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:32.777650 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:32.779457 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:32.779684 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:32.779777 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:32.783003 (+ 3226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:32.783006 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:32.783008 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:32.783033 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:32.784622 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:32.785318 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:32.785321 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:32.785322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:32.785404 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:32.785795 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:32.785798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:32.785799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:32.786095 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:32.786205 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:32.786842 (+ 637us) server_negotiation.cc:299] Negotiation successful
0809 02:25:32.786952 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
I20260809 02:25:32.788076 23591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:32.773064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:37967 (local address 127.21.214.129:34849)
0809 02:25:32.773668 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:32.773730 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:32.775301 (+ 1571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:32.775921 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:32.775936 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:32.776366 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:32.776873 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:32.776887 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:32.777797 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:32.777802 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:32.779318 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:32.779334 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:32.779863 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:32.779870 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:32.780137 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:32.780820 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:32.780844 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:32.782807 (+ 1963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:32.784755 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:32.784761 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:32.784780 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:32.785206 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:32.785534 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:32.785537 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:32.785538 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:32.785689 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:32.786230 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:32.786237 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:32.786578 (+ 341us) client_negotiation.cc:769] Sending connection context
0809 02:25:32.786759 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 02:25:32.787035 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":151,"threads_started":1}
I20260809 02:25:32.789456 23589 heartbeater.cc:347] Connected to a master server at 127.21.214.190:37967
I20260809 02:25:32.789722 23589 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:32.790472 23589 heartbeater.cc:511] Master 127.21.214.190:37967 requested a full tablet report, sending...
I20260809 02:25:32.792227 23282 ts_manager.cc:194] Registered new tserver with Master: b9a3e31e15b24355816f043be4199f59 (127.21.214.129:36403)
I20260809 02:25:32.793437 23282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:34849
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:25:32.805950 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:37967
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:32.921734 23596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:32.922014 23596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:32.922093 23596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:32.926059 23596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:32.926110 23596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:32.926167 23596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:25:32.931348 23596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:37967
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:32.932360 23596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:32.933308 23596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:32.943379 23612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:32.943387 23613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:32.943387 23618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:32.943706 23596 server_base.cc:1034] running on GCE node
I20260809 02:25:32.944235 23596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:32.944972 23596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:32.946238 23596 hybrid_clock.cc:648] HybridClock initialized: now 1786242332946223 us; error 28 us; skew 500 ppm
Aug 09 02:25:32 dist-test-slave-68xk krb5kdc[23206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242332, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:32.949467 23596 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:25:32.950358 23596 webserver.cc:460] Webserver started at http://127.21.214.130:37047/ using document root <none> and password file <none>
I20260809 02:25:32.950997 23596 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:32.951066 23596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:32.951288 23596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:32.953464 23596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a"
format_stamp: "Formatted at 2026-08-09 02:25:32 on dist-test-slave-68xk"
server_key: "5098cf6a8cad1348e79b09035a815124"
server_key_iv: "065acdeec33bf3155aa453db5470af29"
server_key_version: "encryptionkey@0"
I20260809 02:25:32.954034 23596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a"
format_stamp: "Formatted at 2026-08-09 02:25:32 on dist-test-slave-68xk"
server_key: "5098cf6a8cad1348e79b09035a815124"
server_key_iv: "065acdeec33bf3155aa453db5470af29"
server_key_version: "encryptionkey@0"
I20260809 02:25:32.958141 23596 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 02:25:32.960855 23632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:32.962200 23596 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:25:32.962303 23596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a"
format_stamp: "Formatted at 2026-08-09 02:25:32 on dist-test-slave-68xk"
server_key: "5098cf6a8cad1348e79b09035a815124"
server_key_iv: "065acdeec33bf3155aa453db5470af29"
server_key_version: "encryptionkey@0"
I20260809 02:25:32.962390 23596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:32.991501 23596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:32.995368 23596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:32.995539 23596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:32.996130 23596 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:32.996986 23596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:32.997038 23596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:32.997090 23596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:32.997116 23596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:33.008177 23596 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:46041
I20260809 02:25:33.009593 23596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:25:33.010574 23803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:46041 every 8 connection(s)
I20260809 02:25:33.013590 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 23596
I20260809 02:25:33.013692 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:25:33.013989 22362 external_mini_cluster.cc:1428] Setting key 7ab2e540a6873962cdb1232970ab7b0e
Aug 09 02:25:33 dist-test-slave-68xk krb5kdc[23206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242332, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:33.024330 23353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.011994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:47775 (local address 127.21.214.190:37967)
0809 02:25:33.012203 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:33.012208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:33.013123 (+ 915us) server_negotiation.cc:407] Connection header received
0809 02:25:33.014549 (+ 1426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:33.014553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:33.014618 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:33.014723 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:33.015956 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.016488 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.017643 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.017886 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.017996 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.020505 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:33.020513 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:33.020515 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:33.020540 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:33.022131 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:33.022760 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:33.022764 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:33.022766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:33.022846 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:33.023221 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:33.023224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:33.023225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:33.023395 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:33.023505 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:33.024007 (+ 502us) server_negotiation.cc:299] Negotiation successful
0809 02:25:33.024141 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
I20260809 02:25:33.025141 23807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.012421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:37967 (local address 127.21.214.130:47775)
0809 02:25:33.012959 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:33.013004 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:33.014283 (+ 1279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:33.014880 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:33.014887 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:33.015269 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:33.015811 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.015825 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.016622 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.016630 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.017512 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.017521 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.018044 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.018049 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.018219 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.018892 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:33.018909 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:33.020335 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:33.022287 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:33.022293 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:33.022308 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:33.022645 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:33.022950 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:33.022954 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:33.022955 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:33.023099 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:33.023507 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:33.023514 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:33.023761 (+ 247us) client_negotiation.cc:769] Sending connection context
0809 02:25:33.023945 (+ 184us) client_negotiation.cc:240] Negotiation successful
0809 02:25:33.024263 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":151,"threads_started":1}
I20260809 02:25:33.026302 23804 heartbeater.cc:347] Connected to a master server at 127.21.214.190:37967
I20260809 02:25:33.026614 23804 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:33.027148 23804 heartbeater.cc:511] Master 127.21.214.190:37967 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
I20260809 02:25:33.028501 23282 ts_manager.cc:194] Registered new tserver with Master: 6e243f1d61804f2aa3c1e07ddd09ef9a (127.21.214.130:46041)
I20260809 02:25:33.029165 23282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:47775
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:25:33.045637 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:37967
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:33.159015 23810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:33.159257 23810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:33.159299 23810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:33.163347 23810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:33.163408 23810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:33.163491 23810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:25:33.168882 23810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:37967
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:33.170303 23810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:33.171747 23810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:33.181845 23821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:33.181840 23825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:33.181840 23822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:33.182087 23810 server_base.cc:1034] running on GCE node
I20260809 02:25:33.182632 23810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:33.183321 23810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:33.184486 23810 hybrid_clock.cc:648] HybridClock initialized: now 1786242333184445 us; error 55 us; skew 500 ppm
Aug 09 02:25:33 dist-test-slave-68xk krb5kdc[23206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242333, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:33.187311 23810 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:25:33.188090 23810 webserver.cc:460] Webserver started at http://127.21.214.131:46117/ using document root <none> and password file <none>
I20260809 02:25:33.188604 23810 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:33.188663 23810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:33.188822 23810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:33.190845 23810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "815edbc646fd499d94d8fefbb7940ae8"
format_stamp: "Formatted at 2026-08-09 02:25:33 on dist-test-slave-68xk"
server_key: "7f6dc124f7160cba94f83d2df2515074"
server_key_iv: "69d134903bb954e1c752b5ae517e063d"
server_key_version: "encryptionkey@0"
I20260809 02:25:33.191386 23810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "815edbc646fd499d94d8fefbb7940ae8"
format_stamp: "Formatted at 2026-08-09 02:25:33 on dist-test-slave-68xk"
server_key: "7f6dc124f7160cba94f83d2df2515074"
server_key_iv: "69d134903bb954e1c752b5ae517e063d"
server_key_version: "encryptionkey@0"
I20260809 02:25:33.195050 23810 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:25:33.197355 23836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:33.198602 23810 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:33.198729 23810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "815edbc646fd499d94d8fefbb7940ae8"
format_stamp: "Formatted at 2026-08-09 02:25:33 on dist-test-slave-68xk"
server_key: "7f6dc124f7160cba94f83d2df2515074"
server_key_iv: "69d134903bb954e1c752b5ae517e063d"
server_key_version: "encryptionkey@0"
I20260809 02:25:33.198835 23810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:33.236415 23810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:33.239632 23810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:33.239858 23810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:33.240487 23810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:33.241354 23810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:33.241426 23810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:33.241499 23810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:33.241552 23810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:33.251323 23810 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:44641
I20260809 02:25:33.251348 24016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:44641 every 8 connection(s)
I20260809 02:25:33.252314 23810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
Aug 09 02:25:33 dist-test-slave-68xk krb5kdc[23206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242333, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:33.262635 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 23810
I20260809 02:25:33.262755 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:25:33.263047 22362 external_mini_cluster.cc:1428] Setting key 5547eb0edd3c2690bed21707d87b7a5e
I20260809 02:25:33.267202 23353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.254246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:59913 (local address 127.21.214.190:37967)
0809 02:25:33.254398 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:33.254401 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:33.255351 (+ 950us) server_negotiation.cc:407] Connection header received
0809 02:25:33.256604 (+ 1253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:33.256607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:33.256655 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:33.256730 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:33.258209 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.258862 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.260055 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.260292 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.260371 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.263232 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:33.263236 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:33.263239 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:33.263269 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:33.264961 (+ 1692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:33.265561 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:33.265566 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:33.265568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:33.265658 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:33.266041 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:33.266044 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:33.266046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:33.266236 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:33.266354 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:33.266916 (+ 562us) server_negotiation.cc:299] Negotiation successful
0809 02:25:33.267033 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:25:33.268024 24022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.254667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:37967 (local address 127.21.214.131:59913)
0809 02:25:33.255184 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:33.255229 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:33.256394 (+ 1165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:33.256974 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:33.256982 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:33.257517 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:33.258024 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.258039 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.258992 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.258995 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.259942 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.259952 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.260450 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.260453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.260610 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.261306 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:33.261324 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:33.263008 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:33.265096 (+ 2088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:33.265102 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:33.265117 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:33.265449 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:33.265778 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:33.265781 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:33.265783 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:33.265938 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:33.266355 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:33.266363 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:33.266650 (+ 287us) client_negotiation.cc:769] Sending connection context
0809 02:25:33.266852 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 02:25:33.267203 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":104,"threads_started":1}
I20260809 02:25:33.269189 24017 heartbeater.cc:347] Connected to a master server at 127.21.214.190:37967
I20260809 02:25:33.269456 24017 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:33.269979 24017 heartbeater.cc:511] Master 127.21.214.190:37967 requested a full tablet report, sending...
I20260809 02:25:33.271067 23282 ts_manager.cc:194] Registered new tserver with Master: 815edbc646fd499d94d8fefbb7940ae8 (127.21.214.131:44641)
I20260809 02:25:33.271637 23282 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:59913
I20260809 02:25:33.277098 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:25:33.288066 23353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.280579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53000 (local address 127.21.214.190:37967)
0809 02:25:33.280728 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:33.280733 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:33.280872 (+ 139us) server_negotiation.cc:407] Connection header received
0809 02:25:33.280972 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:33.280974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:33.281011 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:33.281076 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:33.281786 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.282320 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.283167 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.283386 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.283460 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.284957 (+ 1497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:33.284959 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:33.284961 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:33.284980 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:33.286499 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:33.286917 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:33.286920 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:33.286921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:33.286996 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:33.287237 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:33.287239 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:33.287240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:33.287442 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:33.287548 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:33.287755 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 02:25:33.287853 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:25:33.292881 23282 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53000:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:25:33.296078 23282 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:25:33.311699 24040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.305742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:44641 (local address 127.0.0.1:45792)
0809 02:25:33.306870 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:33.306884 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:33.306985 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:33.307474 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:33.307478 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:33.307498 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:33.307605 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.307612 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.308783 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.308786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.309944 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.309954 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.310869 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.310873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.311052 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.311096 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 02:25:33.311427 (+ 331us) client_negotiation.cc:240] Negotiation successful
0809 02:25:33.311545 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1067,"mutex_wait_us":29,"thread_start_us":107,"threads_started":1}
I20260809 02:25:33.312100 24042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.305918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45792 (local address 127.21.214.131:44641)
0809 02:25:33.306343 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:33.306356 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:33.306984 (+ 628us) server_negotiation.cc:407] Connection header received
0809 02:25:33.307086 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:33.307089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:33.307316 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:33.307473 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:33.307902 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.308642 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.310074 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.310739 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.310871 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.311017 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:33.311491 (+ 474us) server_negotiation.cc:299] Negotiation successful
0809 02:25:33.311613 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":105,"threads_started":1}
I20260809 02:25:33.312523 24037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.305416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:46041 (local address 127.0.0.1:33252)
0809 02:25:33.306434 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:33.306484 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:33.306621 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:33.307170 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:33.307176 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:33.307200 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:33.307339 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.307346 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.309296 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.309301 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.311003 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.311016 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.312123 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.312126 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.312220 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.312256 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 02:25:33.312321 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:25:33.312397 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":874,"mutex_wait_us":138,"spinlock_wait_cycles":4352,"thread_start_us":99,"threads_started":1}
I20260809 02:25:33.312636 24043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.306072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33252 (local address 127.21.214.130:46041)
0809 02:25:33.306630 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:33.306645 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:33.306674 (+ 29us) server_negotiation.cc:407] Connection header received
0809 02:25:33.306765 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:33.306771 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:33.307002 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:33.307177 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:33.307781 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.309116 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.311175 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.312001 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.312156 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.312308 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:33.312369 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 02:25:33.312470 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":164,"threads_started":1}
I20260809 02:25:33.313270 24041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.305180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:36403 (local address 127.0.0.1:44766)
0809 02:25:33.306432 (+ 1252us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:33.306487 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:33.306621 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:33.307719 (+ 1098us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:33.307721 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:33.307735 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:33.307802 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.307806 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.309313 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.309316 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.311003 (+ 1687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.311016 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.312888 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.312895 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.312997 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.313020 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:25:33.313070 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 02:25:33.313134 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1035,"mutex_wait_us":197,"spinlock_wait_cycles":1408,"thread_start_us":164,"threads_started":1}
I20260809 02:25:33.313949 24038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.305387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44766 (local address 127.21.214.129:36403)
0809 02:25:33.307260 (+ 1873us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:33.307267 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:33.307290 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:25:33.307374 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:33.307379 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:33.307599 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:33.307758 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:33.307904 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.309176 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.311129 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.311961 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.313550 (+ 1589us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.313676 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:33.313723 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 02:25:33.313811 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1760,"thread_start_us":121,"threads_started":1}
I20260809 02:25:33.315296 23701 tablet_service.cc:1467] Processing CreateTablet for tablet 11d3a78315674cc2b936685c13bf50f0 (DEFAULT_TABLE table=test-table [id=bff8ecf38a5446e0a58d34ec7755b635]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:33.315299 23908 tablet_service.cc:1467] Processing CreateTablet for tablet 11d3a78315674cc2b936685c13bf50f0 (DEFAULT_TABLE table=test-table [id=bff8ecf38a5446e0a58d34ec7755b635]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:33.316386 23908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11d3a78315674cc2b936685c13bf50f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:33.316380 23701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11d3a78315674cc2b936685c13bf50f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:33.322932 24044 tablet_bootstrap.cc:492] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a: Bootstrap starting.
I20260809 02:25:33.323896 23492 tablet_service.cc:1467] Processing CreateTablet for tablet 11d3a78315674cc2b936685c13bf50f0 (DEFAULT_TABLE table=test-table [id=bff8ecf38a5446e0a58d34ec7755b635]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:33.325189 23492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11d3a78315674cc2b936685c13bf50f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:33.325563 24044 tablet_bootstrap.cc:654] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:33.325804 24045 tablet_bootstrap.cc:492] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8: Bootstrap starting.
I20260809 02:25:33.326531 24044 log.cc:824] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:33.328150 24045 tablet_bootstrap.cc:654] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:33.328779 24044 tablet_bootstrap.cc:492] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a: No bootstrap required, opened a new log
I20260809 02:25:33.328989 24044 ts_tablet_manager.cc:1397] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:25:33.329432 24045 log.cc:824] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:33.331589 24045 tablet_bootstrap.cc:492] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8: No bootstrap required, opened a new log
I20260809 02:25:33.331801 24045 ts_tablet_manager.cc:1397] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:25:33.332769 24050 tablet_bootstrap.cc:492] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59: Bootstrap starting.
I20260809 02:25:33.332935 24044 raft_consensus.cc:348] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9a3e31e15b24355816f043be4199f59" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36403 } } peers { permanent_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 46041 } } peers { permanent_uuid: "815edbc646fd499d94d8fefbb7940ae8" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44641 } }
I20260809 02:25:33.333532 24044 raft_consensus.cc:374] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:33.333607 24044 raft_consensus.cc:729] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e243f1d61804f2aa3c1e07ddd09ef9a, State: Initialized, Role: FOLLOWER
I20260809 02:25:33.334107 24044 consensus_queue.cc:260] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9a3e31e15b24355816f043be4199f59" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36403 } } peers { permanent_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 46041 } } peers { permanent_uuid: "815edbc646fd499d94d8fefbb7940ae8" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44641 } }
I20260809 02:25:33.334923 23804 heartbeater.cc:503] Master 127.21.214.190:37967 was elected leader, sending a full tablet report...
I20260809 02:25:33.335182 24044 ts_tablet_manager.cc:1428] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a: Time spent starting tablet: real 0.006s user 0.001s sys 0.006s
I20260809 02:25:33.335752 24045 raft_consensus.cc:348] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9a3e31e15b24355816f043be4199f59" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36403 } } peers { permanent_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 46041 } } peers { permanent_uuid: "815edbc646fd499d94d8fefbb7940ae8" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44641 } }
I20260809 02:25:33.335958 24050 tablet_bootstrap.cc:654] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:33.336050 24045 raft_consensus.cc:374] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:33.336108 24045 raft_consensus.cc:729] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 815edbc646fd499d94d8fefbb7940ae8, State: Initialized, Role: FOLLOWER
I20260809 02:25:33.336565 24045 consensus_queue.cc:260] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9a3e31e15b24355816f043be4199f59" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36403 } } peers { permanent_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 46041 } } peers { permanent_uuid: "815edbc646fd499d94d8fefbb7940ae8" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44641 } }
I20260809 02:25:33.337121 24050 log.cc:824] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:33.337473 24045 ts_tablet_manager.cc:1428] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:25:33.337832 24017 heartbeater.cc:503] Master 127.21.214.190:37967 was elected leader, sending a full tablet report...
I20260809 02:25:33.339413 24050 tablet_bootstrap.cc:492] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59: No bootstrap required, opened a new log
I20260809 02:25:33.339635 24050 ts_tablet_manager.cc:1397] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 02:25:33.344002 24050 raft_consensus.cc:348] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9a3e31e15b24355816f043be4199f59" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36403 } } peers { permanent_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 46041 } } peers { permanent_uuid: "815edbc646fd499d94d8fefbb7940ae8" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44641 } }
I20260809 02:25:33.344302 24050 raft_consensus.cc:374] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:33.344394 24050 raft_consensus.cc:729] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9a3e31e15b24355816f043be4199f59, State: Initialized, Role: FOLLOWER
I20260809 02:25:33.344830 24050 consensus_queue.cc:260] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9a3e31e15b24355816f043be4199f59" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36403 } } peers { permanent_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 46041 } } peers { permanent_uuid: "815edbc646fd499d94d8fefbb7940ae8" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44641 } }
I20260809 02:25:33.345583 23589 heartbeater.cc:503] Master 127.21.214.190:37967 was elected leader, sending a full tablet report...
I20260809 02:25:33.345753 24050 ts_tablet_manager.cc:1428] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260809 02:25:33.503371 24018 tablet.cc:2369] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:25:33.510860 23805 tablet.cc:2369] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:25:33.522305 23590 tablet.cc:2369] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:25:33.691288 24051 raft_consensus.cc:482] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:25:33.691571 24051 raft_consensus.cc:504] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9a3e31e15b24355816f043be4199f59" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36403 } } peers { permanent_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 46041 } } peers { permanent_uuid: "815edbc646fd499d94d8fefbb7940ae8" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44641 } }
I20260809 02:25:33.692915 24051 leader_election.cc:288] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9a3e31e15b24355816f043be4199f59 (127.21.214.129:36403), 815edbc646fd499d94d8fefbb7940ae8 (127.21.214.131:44641)
I20260809 02:25:33.697268 24061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.693308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:44641 (local address 127.21.214.130:48817)
0809 02:25:33.693689 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:33.693701 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:33.693837 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:33.694110 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:33.694113 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:33.694130 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:33.694367 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.694378 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.695185 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.695191 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.696089 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.696098 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.696806 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.696810 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.696912 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.696936 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:25:33.697009 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 02:25:33.697083 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":40,"thread_start_us":109,"threads_started":1}
I20260809 02:25:33.697280 24060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.693127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:36403 (local address 127.21.214.130:53093)
0809 02:25:33.693498 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:33.693515 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:33.693713 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:33.694027 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:33.694030 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:33.694056 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:33.694199 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.694204 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.695121 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.695127 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.696104 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:33.696114 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.696928 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.696931 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:33.697033 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.697051 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 02:25:33.697119 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 02:25:33.697177 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":61,"thread_start_us":99,"threads_started":1}
I20260809 02:25:33.697319 24042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.693489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:48817 (local address 127.21.214.131:44641)
0809 02:25:33.693622 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:33.693627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:33.693796 (+ 169us) server_negotiation.cc:407] Connection header received
0809 02:25:33.693965 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:33.693968 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:33.694011 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:33.694096 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:33.694547 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.695062 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.696252 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.696667 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.696801 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.696856 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:33.697073 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 02:25:33.697187 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:25:33.697363 24038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.693346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:53093 (local address 127.21.214.129:36403)
0809 02:25:33.693494 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:33.693499 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:33.693614 (+ 115us) server_negotiation.cc:407] Connection header received
0809 02:25:33.693854 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:33.693858 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:33.693914 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:33.694011 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:33.694331 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.694982 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.696249 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.696747 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.696902 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.696978 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:33.697160 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 02:25:33.697244 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:25:33.698031 23526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11d3a78315674cc2b936685c13bf50f0" candidate_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a3e31e15b24355816f043be4199f59" is_pre_election: true
I20260809 02:25:33.698160 23943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11d3a78315674cc2b936685c13bf50f0" candidate_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815edbc646fd499d94d8fefbb7940ae8" is_pre_election: true
I20260809 02:25:33.698434 23526 raft_consensus.cc:2454] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e243f1d61804f2aa3c1e07ddd09ef9a in term 0.
I20260809 02:25:33.698465 23943 raft_consensus.cc:2454] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e243f1d61804f2aa3c1e07ddd09ef9a in term 0.
I20260809 02:25:33.698979 23637 leader_election.cc:302] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e243f1d61804f2aa3c1e07ddd09ef9a, 815edbc646fd499d94d8fefbb7940ae8; no voters:
I20260809 02:25:33.699280 24051 raft_consensus.cc:2781] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:25:33.699383 24051 raft_consensus.cc:482] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:25:33.699460 24051 raft_consensus.cc:3037] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:33.700521 24051 raft_consensus.cc:504] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9a3e31e15b24355816f043be4199f59" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36403 } } peers { permanent_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 46041 } } peers { permanent_uuid: "815edbc646fd499d94d8fefbb7940ae8" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44641 } }
I20260809 02:25:33.700917 24051 leader_election.cc:288] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [CANDIDATE]: Term 1 election: Requested vote from peers b9a3e31e15b24355816f043be4199f59 (127.21.214.129:36403), 815edbc646fd499d94d8fefbb7940ae8 (127.21.214.131:44641)
I20260809 02:25:33.701388 23943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11d3a78315674cc2b936685c13bf50f0" candidate_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815edbc646fd499d94d8fefbb7940ae8"
I20260809 02:25:33.701354 23526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11d3a78315674cc2b936685c13bf50f0" candidate_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9a3e31e15b24355816f043be4199f59"
I20260809 02:25:33.701521 23943 raft_consensus.cc:3037] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:33.701521 23526 raft_consensus.cc:3037] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:33.703078 23526 raft_consensus.cc:2454] T 11d3a78315674cc2b936685c13bf50f0 P b9a3e31e15b24355816f043be4199f59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e243f1d61804f2aa3c1e07ddd09ef9a in term 1.
I20260809 02:25:33.703080 23943 raft_consensus.cc:2454] T 11d3a78315674cc2b936685c13bf50f0 P 815edbc646fd499d94d8fefbb7940ae8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e243f1d61804f2aa3c1e07ddd09ef9a in term 1.
I20260809 02:25:33.703404 23634 leader_election.cc:302] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e243f1d61804f2aa3c1e07ddd09ef9a, b9a3e31e15b24355816f043be4199f59; no voters:
I20260809 02:25:33.703606 24051 raft_consensus.cc:2781] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:33.703876 24051 raft_consensus.cc:686] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [term 1 LEADER]: Becoming Leader. State: Replica: 6e243f1d61804f2aa3c1e07ddd09ef9a, State: Running, Role: LEADER
I20260809 02:25:33.704262 24051 consensus_queue.cc:237] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9a3e31e15b24355816f043be4199f59" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36403 } } peers { permanent_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 46041 } } peers { permanent_uuid: "815edbc646fd499d94d8fefbb7940ae8" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44641 } }
I20260809 02:25:33.707454 23281 catalog_manager.cc:5495] T 11d3a78315674cc2b936685c13bf50f0 P 6e243f1d61804f2aa3c1e07ddd09ef9a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e243f1d61804f2aa3c1e07ddd09ef9a (127.21.214.130). New cstate: current_term: 1 leader_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9a3e31e15b24355816f043be4199f59" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e243f1d61804f2aa3c1e07ddd09ef9a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 46041 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "815edbc646fd499d94d8fefbb7940ae8" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44641 } health_report { overall_health: UNKNOWN } } }
Aug 09 02:25:33 dist-test-slave-68xk krb5kdc[23206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.129@KRBTEST.COM
I20260809 02:25:33.765623 24038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.756334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44782 (local address 127.21.214.129:36403)
0809 02:25:33.756500 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:33.756506 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:33.756608 (+ 102us) server_negotiation.cc:407] Connection header received
0809 02:25:33.756776 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:33.756779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:33.756851 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:33.756956 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:33.757747 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.758293 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.759187 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.759403 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.759489 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.761968 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:33.761983 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:33.761999 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:33.762023 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:33.763899 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:33.764288 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:33.764294 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:33.764295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:33.764381 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:33.764653 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:33.764658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:33.764661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:33.764957 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:33.765203 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:33.765369 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 02:25:33.765483 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 02:25:33 dist-test-slave-68xk krb5kdc[23206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242333, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:25:33 dist-test-slave-68xk krb5kdc[23206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242333, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.214.129@KRBTEST.COM
I20260809 02:25:33.798851 24038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.789860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44796 (local address 127.21.214.129:36403)
0809 02:25:33.790031 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:33.790036 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:33.790212 (+ 176us) server_negotiation.cc:407] Connection header received
0809 02:25:33.790350 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:33.790358 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:33.790400 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:33.790536 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:33.791222 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.791745 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.792567 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.792793 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.792902 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.795428 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:33.795431 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:33.795433 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:33.795456 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:33.797009 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:33.797457 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:33.797460 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:33.797462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:33.797550 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:33.797880 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:33.797883 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:33.797884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:33.798079 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:33.798192 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:33.798580 (+ 388us) server_negotiation.cc:299] Negotiation successful
0809 02:25:33.798724 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
Aug 09 02:25:33 dist-test-slave-68xk krb5kdc[23206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:25:33 dist-test-slave-68xk krb5kdc[23206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.129@KRBTEST.COM
I20260809 02:25:33.826933 24038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:33.818532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44806 (local address 127.21.214.129:36403)
0809 02:25:33.818689 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:33.818692 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:33.818708 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:25:33.818827 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:33.818829 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:33.818895 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:33.818990 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:33.819685 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.820207 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.821023 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:33.821286 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:33.821412 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:33.823788 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:33.823791 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:33.823793 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:33.823819 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:33.825357 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:33.825791 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:33.825793 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:33.825794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:33.825867 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:33.826130 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:33.826132 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:33.826134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:33.826287 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:33.826387 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:33.826709 (+ 322us) server_negotiation.cc:299] Negotiation successful
0809 02:25:33.826812 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260809 02:25:33.828370 23459 tablet_service.cc:2908] Rejecting scan request for tablet 11d3a78315674cc2b936685c13bf50f0: Uninitialized: clean time has not yet been initialized
I20260809 02:25:33.830340 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 23391
I20260809 02:25:33.842130 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 23596
I20260809 02:25:33.851501 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 23810
I20260809 02:25:33.862243 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 23231
2026-08-09T02:25:33Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (3007 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:33 dist-test-slave-68xk krb5kdc[24082](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:33 dist-test-slave-68xk krb5kdc[24082](info): set up 2 sockets
Aug 09 02:25:33 dist-test-slave-68xk krb5kdc[24082](info): commencing operation
krb5kdc: starting...
W20260809 02:25:35.108804 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:25:35 dist-test-slave-68xk krb5kdc[24082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:25:35.242125 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:38251
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:32883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:38251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:35.357239 24101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:35.357509 24101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:35.357548 24101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:35.361577 24101 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:35.361639 24101 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 02:25:35.361657 24101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:35.361675 24101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:35.361691 24101 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:35.361706 24101 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:35.366842 24101 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:32883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:38251
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:38251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:35.367813 24101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:35.368911 24101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:25:35.377754 24101 server_base.cc:1034] running on GCE node
W20260809 02:25:35.377722 24111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:35.377707 24113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:35.377707 24110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:35.378643 24101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:35.379747 24101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:35.380972 24101 hybrid_clock.cc:648] HybridClock initialized: now 1786242335380950 us; error 35 us; skew 500 ppm
Aug 09 02:25:35 dist-test-slave-68xk krb5kdc[24082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242335, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:35.387419 24101 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:25:35.388454 24101 webserver.cc:460] Webserver started at http://127.21.214.190:41451/ using document root <none> and password file <none>
I20260809 02:25:35.389168 24101 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:35.389271 24101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:35.389549 24101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:35.392092 24101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "9d31f2e7ba024098902030d2bab0d952"
format_stamp: "Formatted at 2026-08-09 02:25:35 on dist-test-slave-68xk"
server_key: "dcbe64332fea0ebd7dbb318c3ced933b"
server_key_iv: "c08ccde9b9d359b1d8d7198b425c2372"
server_key_version: "encryptionkey@0"
I20260809 02:25:35.392768 24101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "9d31f2e7ba024098902030d2bab0d952"
format_stamp: "Formatted at 2026-08-09 02:25:35 on dist-test-slave-68xk"
server_key: "dcbe64332fea0ebd7dbb318c3ced933b"
server_key_iv: "c08ccde9b9d359b1d8d7198b425c2372"
server_key_version: "encryptionkey@0"
I20260809 02:25:35.397185 24101 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:25:35.400098 24121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:35.401628 24101 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 02:25:35.401804 24101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "9d31f2e7ba024098902030d2bab0d952"
format_stamp: "Formatted at 2026-08-09 02:25:35 on dist-test-slave-68xk"
server_key: "dcbe64332fea0ebd7dbb318c3ced933b"
server_key_iv: "c08ccde9b9d359b1d8d7198b425c2372"
server_key_version: "encryptionkey@0"
I20260809 02:25:35.401935 24101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:35.444201 24101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:35.448096 24101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:35.448354 24101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:35.457468 24101 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:38251
I20260809 02:25:35.457499 24218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:38251 every 8 connection(s)
I20260809 02:25:35.458560 24101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:35.459894 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 24101
I20260809 02:25:35.459993 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:35.460304 22362 external_mini_cluster.cc:1428] Setting key f6944e1905c0249757911ba616c7b911
I20260809 02:25:35.461701 24220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:35.467880 24220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952: Bootstrap starting.
I20260809 02:25:35.470506 24220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952: Neither blocks nor log segments found. Creating new log.
Aug 09 02:25:35 dist-test-slave-68xk krb5kdc[24082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242335, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:35.471417 24220 log.cc:824] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:35.473680 24220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952: No bootstrap required, opened a new log
I20260809 02:25:35.477073 24223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:35.462557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35046 (local address 127.21.214.190:38251)
0809 02:25:35.463020 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:35.463036 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:35.463075 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:25:35.463795 (+ 720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:35.463812 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:35.464200 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:35.464560 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:35.465464 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.466629 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.467565 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.468144 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.468327 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:35.471255 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:35.471260 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:35.471274 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:35.471302 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:35.474139 (+ 2837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:35.474685 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:35.474690 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:35.474694 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:35.474810 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:35.475115 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:35.475117 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:35.475118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:35.475506 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:35.475666 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:35.475960 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 02:25:35.476286 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":137,"threads_started":1}
I20260809 02:25:35.477375 24220 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d31f2e7ba024098902030d2bab0d952" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38251 } }
I20260809 02:25:35.477622 24220 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:35.477706 24220 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d31f2e7ba024098902030d2bab0d952, State: Initialized, Role: FOLLOWER
I20260809 02:25:35.478166 24220 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d31f2e7ba024098902030d2bab0d952" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38251 } }
I20260809 02:25:35.478322 24220 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:35.478415 24220 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:35.478549 24220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:35.479465 24220 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d31f2e7ba024098902030d2bab0d952" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38251 } }
I20260809 02:25:35.479820 24220 leader_election.cc:302] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d31f2e7ba024098902030d2bab0d952; no voters:
I20260809 02:25:35.480171 24220 leader_election.cc:288] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:35.480468 24231 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:35.480732 24231 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [term 1 LEADER]: Becoming Leader. State: Replica: 9d31f2e7ba024098902030d2bab0d952, State: Running, Role: LEADER
I20260809 02:25:35.481081 24231 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d31f2e7ba024098902030d2bab0d952" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38251 } }
I20260809 02:25:35.481496 24220 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:35.483137 24235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d31f2e7ba024098902030d2bab0d952. Latest consensus state: current_term: 1 leader_uuid: "9d31f2e7ba024098902030d2bab0d952" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d31f2e7ba024098902030d2bab0d952" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38251 } } }
I20260809 02:25:35.483781 24235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:35.483428 24234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d31f2e7ba024098902030d2bab0d952" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d31f2e7ba024098902030d2bab0d952" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38251 } } }
I20260809 02:25:35.484658 24234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952 [sys.catalog]: This master's current role is: LEADER
W20260809 02:25:35.486383 24251 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:35.486515 24251 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:35.486610 24253 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:35.487635 24253 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:35.493657 24253 catalog_manager.cc:1347] Generated new cluster ID: 625dd2a6702043408ce873307dc7ca7a
I20260809 02:25:35.493728 24253 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:35.506453 24253 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:35.507405 24253 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:35.511454 24253 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952: Generated new TSK 0
I20260809 02:25:35.512269 24253 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:25:35.549636 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:38251
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:32883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:35.671905 24266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:35.672194 24266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:35.672253 24266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:35.676453 24266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:35.676510 24266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:35.676550 24266 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:25:35.676582 24266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:25:35.681782 24266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:32883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.214.190:38251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:35.682988 24266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:35.684041 24266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:35.693818 24278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:35.693812 24274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:35.693835 24276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:35.694681 24266 server_base.cc:1034] running on GCE node
I20260809 02:25:35.695104 24266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:35.695801 24266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:35.696979 24266 hybrid_clock.cc:648] HybridClock initialized: now 1786242335696961 us; error 29 us; skew 500 ppm
Aug 09 02:25:35 dist-test-slave-68xk krb5kdc[24082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242335, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:35.700171 24266 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:25:35.701202 24266 webserver.cc:460] Webserver started at http://127.21.214.129:34843/ using document root <none> and password file <none>
I20260809 02:25:35.701754 24266 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:35.701817 24266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:35.701988 24266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:35.704176 24266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "68cc33ad7c91433bbdcde43ba466f54a"
format_stamp: "Formatted at 2026-08-09 02:25:35 on dist-test-slave-68xk"
server_key: "c0885ea9db5bacea118350fe7971be17"
server_key_iv: "ec5640d50d115a3fceee6a0d6c448469"
server_key_version: "encryptionkey@0"
I20260809 02:25:35.704732 24266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "68cc33ad7c91433bbdcde43ba466f54a"
format_stamp: "Formatted at 2026-08-09 02:25:35 on dist-test-slave-68xk"
server_key: "c0885ea9db5bacea118350fe7971be17"
server_key_iv: "ec5640d50d115a3fceee6a0d6c448469"
server_key_version: "encryptionkey@0"
I20260809 02:25:35.708844 24266 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 02:25:35.711440 24288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:35.712918 24266 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 02:25:35.713063 24266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "68cc33ad7c91433bbdcde43ba466f54a"
format_stamp: "Formatted at 2026-08-09 02:25:35 on dist-test-slave-68xk"
server_key: "c0885ea9db5bacea118350fe7971be17"
server_key_iv: "ec5640d50d115a3fceee6a0d6c448469"
server_key_version: "encryptionkey@0"
I20260809 02:25:35.713215 24266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:35.736279 24266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:35.739567 24266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:35.739775 24266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:35.741317 24266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:35.741366 24266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:35.741407 24266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:35.741422 24266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:25:35 dist-test-slave-68xk krb5kdc[24082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242335, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:35.753069 24266 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:39599
I20260809 02:25:35.753400 24458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:39599 every 8 connection(s)
I20260809 02:25:35.754266 24266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:25:35.756448 24223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:35.742268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:59007 (local address 127.21.214.190:38251)
0809 02:25:35.742404 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:35.742444 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:35.743477 (+ 1033us) server_negotiation.cc:407] Connection header received
0809 02:25:35.744480 (+ 1003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:35.744483 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:35.744547 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:35.744611 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:35.746525 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.747470 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.748789 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.749213 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.749352 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:35.752228 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:35.752232 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:35.752235 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:35.752265 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:35.754066 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:35.754783 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:35.754787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:35.754789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:35.754879 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:35.755311 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:35.755314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:35.755316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:35.755515 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:35.755629 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:35.756127 (+ 498us) server_negotiation.cc:299] Negotiation successful
0809 02:25:35.756273 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:25:35.757236 24300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:35.742827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:38251 (local address 127.21.214.129:59007)
0809 02:25:35.743319 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:35.743363 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:35.744199 (+ 836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:35.745131 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:35.745143 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:35.745690 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:35.746340 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:35.746362 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.747605 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.747608 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:35.748640 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:35.748658 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.749397 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.749403 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:35.749605 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:35.750233 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:35.750250 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:35.752045 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:35.754231 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:35.754235 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:35.754247 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:35.754665 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:35.754977 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:35.754981 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:35.754983 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:35.755197 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:35.755630 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:35.755637 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:35.755881 (+ 244us) client_negotiation.cc:769] Sending connection context
0809 02:25:35.756066 (+ 185us) client_negotiation.cc:240] Negotiation successful
0809 02:25:35.756395 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":133,"threads_started":1}
I20260809 02:25:35.757493 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 24266
I20260809 02:25:35.757629 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:25:35.757916 22362 external_mini_cluster.cc:1428] Setting key eaa27483f17186c03ba97ad4535b943d
I20260809 02:25:35.759594 24459 heartbeater.cc:347] Connected to a master server at 127.21.214.190:38251
I20260809 02:25:35.759797 24459 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:35.760303 24459 heartbeater.cc:511] Master 127.21.214.190:38251 requested a full tablet report, sending...
I20260809 02:25:35.761981 24148 ts_manager.cc:194] Registered new tserver with Master: 68cc33ad7c91433bbdcde43ba466f54a (127.21.214.129:39599)
I20260809 02:25:35.763657 24148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:59007
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:25:35.769755 24223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:35.762165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:58799 (local address 127.21.214.190:38251)
0809 02:25:35.762453 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:35.762458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:35.762535 (+ 77us) server_negotiation.cc:407] Connection header received
0809 02:25:35.762683 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:35.762686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:35.762735 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:35.762818 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:35.763274 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.763792 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.764805 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.765031 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.765160 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:35.766508 (+ 1348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:35.766512 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:35.766514 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:35.766539 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:35.768021 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:35.768471 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:35.768475 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:35.768477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:35.768564 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:35.768854 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:35.768858 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:35.768860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:35.769030 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:35.769142 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:35.769467 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 02:25:35.769588 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182}
I20260809 02:25:35.769767 24468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:35.762126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:38251 (local address 127.21.214.129:58799)
0809 02:25:35.762402 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:35.762442 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:35.762587 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:35.762835 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:35.762838 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:35.763050 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:35.763156 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:35.763162 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.763928 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.763932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:35.764676 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:35.764686 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.765269 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.765273 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:35.765413 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:35.765958 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:35.765969 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:35.766325 (+ 356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:35.768143 (+ 1818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:35.768148 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:35.768157 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:35.768367 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:35.768664 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:35.768670 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:35.768673 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:35.768761 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:35.769134 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:35.769137 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:35.769287 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 02:25:35.769408 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 02:25:35.769563 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":19,"thread_start_us":111,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:25:35.790288 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:38251
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:32883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:35.907027 24470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:35.907292 24470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:35.907339 24470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:35.911841 24470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:35.911912 24470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:35.911979 24470 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:25:35.912036 24470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:25:35.917562 24470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:32883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.214.190:38251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:35.918711 24470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:35.919687 24470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:35.929629 24481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:35.929617 24482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:35.929675 24485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:35.929824 24470 server_base.cc:1034] running on GCE node
I20260809 02:25:35.930395 24470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:35.931083 24470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:35.932267 24470 hybrid_clock.cc:648] HybridClock initialized: now 1786242335932239 us; error 54 us; skew 500 ppm
Aug 09 02:25:35 dist-test-slave-68xk krb5kdc[24082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242335, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:35.935274 24470 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:25:35.936194 24470 webserver.cc:460] Webserver started at http://127.21.214.130:34735/ using document root <none> and password file <none>
I20260809 02:25:35.936770 24470 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:35.936836 24470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:35.937093 24470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:35.939235 24470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "9cbbe01c796441959c982e8e2dfe74c8"
format_stamp: "Formatted at 2026-08-09 02:25:35 on dist-test-slave-68xk"
server_key: "4e12bfefef673e62b00c6355a3288373"
server_key_iv: "6540119864af8627928777b34764ef22"
server_key_version: "encryptionkey@0"
I20260809 02:25:35.939818 24470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "9cbbe01c796441959c982e8e2dfe74c8"
format_stamp: "Formatted at 2026-08-09 02:25:35 on dist-test-slave-68xk"
server_key: "4e12bfefef673e62b00c6355a3288373"
server_key_iv: "6540119864af8627928777b34764ef22"
server_key_version: "encryptionkey@0"
I20260809 02:25:35.943684 24470 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:25:35.946362 24495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:35.947868 24470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:25:35.947974 24470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "9cbbe01c796441959c982e8e2dfe74c8"
format_stamp: "Formatted at 2026-08-09 02:25:35 on dist-test-slave-68xk"
server_key: "4e12bfefef673e62b00c6355a3288373"
server_key_iv: "6540119864af8627928777b34764ef22"
server_key_version: "encryptionkey@0"
I20260809 02:25:35.948148 24470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:35.962999 24470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:35.966140 24470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:35.966349 24470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:35.967944 24470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:35.967998 24470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:35.968041 24470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:35.968091 24470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:25:35 dist-test-slave-68xk krb5kdc[24082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242335, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:35.979991 24470 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:33233
I20260809 02:25:35.980077 24683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:33233 every 8 connection(s)
I20260809 02:25:35.981113 24470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:25:35.982662 24223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:35.968851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:45501 (local address 127.21.214.190:38251)
0809 02:25:35.968989 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:35.968993 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:35.970089 (+ 1096us) server_negotiation.cc:407] Connection header received
0809 02:25:35.971280 (+ 1191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:35.971287 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:35.971356 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:35.971427 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:35.972931 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.973586 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.975175 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.975400 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.975519 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:35.978353 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:35.978358 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:35.978361 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:35.978396 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:35.980160 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:35.980666 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:35.980672 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:35.980677 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:35.980781 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:35.981305 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:35.981308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:35.981310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:35.981580 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:35.981686 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:35.982338 (+ 652us) server_negotiation.cc:299] Negotiation successful
0809 02:25:35.982518 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:25:35.983546 24511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:35.969370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:38251 (local address 127.21.214.130:45501)
0809 02:25:35.969916 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:35.969959 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:35.970974 (+ 1015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:35.971840 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:35.971846 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:35.972170 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:35.972754 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:35.972780 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.973729 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.973733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:35.975040 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:35.975050 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.975582 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.975586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:35.975770 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:35.976375 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:35.976397 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:35.978168 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:35.980287 (+ 2119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:35.980292 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:35.980303 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:35.980550 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:35.980882 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:35.980884 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:35.980885 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:35.981132 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:35.981743 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:35.981751 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:35.982055 (+ 304us) client_negotiation.cc:769] Sending connection context
0809 02:25:35.982290 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 02:25:35.982675 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":149,"threads_started":1}
I20260809 02:25:35.984972 24684 heartbeater.cc:347] Connected to a master server at 127.21.214.190:38251
I20260809 02:25:35.985129 24684 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:35.985750 24684 heartbeater.cc:511] Master 127.21.214.190:38251 requested a full tablet report, sending...
I20260809 02:25:35.986929 24146 ts_manager.cc:194] Registered new tserver with Master: 9cbbe01c796441959c982e8e2dfe74c8 (127.21.214.130:33233)
I20260809 02:25:35.987725 24146 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:45501
I20260809 02:25:35.988121 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 24470
I20260809 02:25:35.988234 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:25:35.988521 22362 external_mini_cluster.cc:1428] Setting key 643895c5c54d14489a26497f8902a959
I20260809 02:25:35.995524 24692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:35.987432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:38251 (local address 127.21.214.130:53463)
0809 02:25:35.987717 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:35.987731 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:35.987856 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:35.988178 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:35.988183 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:35.988414 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:35.988548 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:35.988565 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.989445 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.989448 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:35.990156 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:35.990168 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.990719 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.990732 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:35.990858 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:35.991460 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:35.991480 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:35.991989 (+ 509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:35.993965 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:35.993968 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:35.993969 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:35.994166 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:35.994495 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:35.994502 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:35.994503 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:35.994583 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:35.995113 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:35.995115 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:35.995191 (+ 76us) client_negotiation.cc:769] Sending connection context
0809 02:25:35.995273 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 02:25:35.995379 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":104,"threads_started":1}
I20260809 02:25:35.995764 24223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:35.987507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:53463 (local address 127.21.214.190:38251)
0809 02:25:35.987672 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:35.987676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:35.987810 (+ 134us) server_negotiation.cc:407] Connection header received
0809 02:25:35.987946 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:35.987949 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:35.987996 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:35.988064 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:35.988672 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.989312 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.990292 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:35.990597 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:35.990681 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:35.992142 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:35.992148 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:35.992154 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:35.992184 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:35.993840 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:35.994269 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:35.994276 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:35.994280 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:35.994374 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:35.994682 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:35.994688 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:35.994693 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:35.994993 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:35.995122 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:35.995363 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 02:25:35.995523 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:25:36.022379 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:38251
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:32883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:36.136425 24698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:36.136710 24698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:36.136786 24698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:36.140816 24698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:36.140902 24698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:36.140974 24698 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:25:36.141059 24698 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:25:36.146179 24698 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:32883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.214.190:38251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:36.147253 24698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:36.148295 24698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:36.158452 24707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:36.158452 24710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:36.158492 24698 server_base.cc:1034] running on GCE node
W20260809 02:25:36.158716 24708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:36.159139 24698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:36.159849 24698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:36.161027 24698 hybrid_clock.cc:648] HybridClock initialized: now 1786242336160992 us; error 46 us; skew 500 ppm
Aug 09 02:25:36 dist-test-slave-68xk krb5kdc[24082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242336, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:36.164001 24698 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:25:36.164897 24698 webserver.cc:460] Webserver started at http://127.21.214.131:42621/ using document root <none> and password file <none>
I20260809 02:25:36.165437 24698 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:36.165496 24698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:36.165657 24698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:36.167765 24698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "977d9fa061874c20a4d02f181357d208"
format_stamp: "Formatted at 2026-08-09 02:25:36 on dist-test-slave-68xk"
server_key: "4138c58370a24e9def39f8bdb5799de9"
server_key_iv: "a52319b21bb3e6fd3111b3d9444d42be"
server_key_version: "encryptionkey@0"
I20260809 02:25:36.168298 24698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "977d9fa061874c20a4d02f181357d208"
format_stamp: "Formatted at 2026-08-09 02:25:36 on dist-test-slave-68xk"
server_key: "4138c58370a24e9def39f8bdb5799de9"
server_key_iv: "a52319b21bb3e6fd3111b3d9444d42be"
server_key_version: "encryptionkey@0"
I20260809 02:25:36.172040 24698 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:25:36.174567 24720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:36.175863 24698 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:36.176002 24698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "977d9fa061874c20a4d02f181357d208"
format_stamp: "Formatted at 2026-08-09 02:25:36 on dist-test-slave-68xk"
server_key: "4138c58370a24e9def39f8bdb5799de9"
server_key_iv: "a52319b21bb3e6fd3111b3d9444d42be"
server_key_version: "encryptionkey@0"
I20260809 02:25:36.176113 24698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:36.188872 24698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:36.191679 24698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:36.191883 24698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:36.193289 24698 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:36.193341 24698 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:36.193380 24698 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:36.193436 24698 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:25:36 dist-test-slave-68xk krb5kdc[24082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242336, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:36.204571 24698 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:44939
I20260809 02:25:36.204659 24894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:44939 every 8 connection(s)
I20260809 02:25:36.205696 24698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:25:36.208261 24223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.193976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:55263 (local address 127.21.214.190:38251)
0809 02:25:36.194146 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:36.194151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:36.195509 (+ 1358us) server_negotiation.cc:407] Connection header received
0809 02:25:36.196922 (+ 1413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:36.196926 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:36.196985 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:36.197062 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:36.198778 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.199486 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.201294 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.201567 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.201652 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.204444 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:36.204446 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:36.204448 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:36.204472 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:36.206196 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:36.206867 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:36.206870 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:36.206871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:36.206995 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:36.207313 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:36.207315 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:36.207317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:36.207486 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:36.207562 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:36.207998 (+ 436us) server_negotiation.cc:299] Negotiation successful
0809 02:25:36.208101 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 02:25:36.208998 24734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.194843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:38251 (local address 127.21.214.131:55263)
0809 02:25:36.195320 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:36.195384 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:36.196672 (+ 1288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:36.197272 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:36.197281 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:36.197816 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:36.198576 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.198603 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.199606 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.199610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.201142 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.201153 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.201747 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.201751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.201963 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.202687 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:36.202708 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:36.204244 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:36.206390 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:36.206395 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:36.206489 (+ 94us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:36.206747 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:36.207066 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:36.207069 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:36.207070 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:36.207189 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:36.207576 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:36.207580 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:36.207789 (+ 209us) client_negotiation.cc:769] Sending connection context
0809 02:25:36.207931 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 02:25:36.208162 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":107,"threads_started":1}
I20260809 02:25:36.209353 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 24698
I20260809 02:25:36.209496 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:25:36.209844 22362 external_mini_cluster.cc:1428] Setting key 6b12efa95a8864b7c513d2979f53b7c3
I20260809 02:25:36.210352 24895 heartbeater.cc:347] Connected to a master server at 127.21.214.190:38251
I20260809 02:25:36.210530 24895 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:36.211124 24895 heartbeater.cc:511] Master 127.21.214.190:38251 requested a full tablet report, sending...
I20260809 02:25:36.212194 24148 ts_manager.cc:194] Registered new tserver with Master: 977d9fa061874c20a4d02f181357d208 (127.21.214.131:44939)
I20260809 02:25:36.212977 24148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:55263
I20260809 02:25:36.219498 24223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.212489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:53603 (local address 127.21.214.190:38251)
0809 02:25:36.212602 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:36.212606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:36.212821 (+ 215us) server_negotiation.cc:407] Connection header received
0809 02:25:36.212933 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:36.212935 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:36.212968 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:36.213029 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:36.213531 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.214258 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.215388 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.215594 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.215675 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.216713 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:36.216715 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:36.216718 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:36.216777 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:36.218007 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:36.218383 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:36.218385 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:36.218386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:36.218513 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:36.218830 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:36.218833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:36.218834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:36.218978 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:36.219052 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:36.219316 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 02:25:36.219399 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:25:36.219534 24903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.212420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:38251 (local address 127.21.214.131:53603)
0809 02:25:36.212751 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:36.212771 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:36.212860 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:36.213071 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:36.213074 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:36.213290 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:36.213413 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.213419 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.214537 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.214540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.215281 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.215291 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.215694 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.215696 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.215775 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.216289 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:36.216302 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:36.216605 (+ 303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:36.218102 (+ 1497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:36.218105 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:36.218106 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:36.218300 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:36.218640 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:36.218643 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:36.218644 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:36.218739 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:36.219068 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:36.219072 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:36.219160 (+ 88us) client_negotiation.cc:769] Sending connection context
0809 02:25:36.219268 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 02:25:36.219381 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":97,"threads_started":1}
I20260809 02:25:36.223714 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:25:36 dist-test-slave-68xk krb5kdc[24082](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242336, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:25:36 dist-test-slave-68xk krb5kdc[24082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242336, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:36.250633 24223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.242593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35054 (local address 127.21.214.190:38251)
0809 02:25:36.242733 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:36.242737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:36.242748 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:25:36.242786 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:36.242788 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:36.242826 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:36.242921 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:36.243642 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.244157 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.245009 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.245254 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.245366 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.247802 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:36.247805 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:36.247807 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:36.247831 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:36.249064 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:36.249458 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:36.249461 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:36.249462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:36.249538 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:36.249782 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:36.249784 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:36.249785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:36.249946 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:36.250044 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:36.250242 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 02:25:36.250342 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 02:25:36.253686 24148 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35054:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:25:36.256857 24148 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:25:36.272614 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.266663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47848 (local address 127.21.214.129:39599)
0809 02:25:36.266927 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:36.266935 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:36.267337 (+ 402us) server_negotiation.cc:407] Connection header received
0809 02:25:36.267625 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:36.267630 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:36.267774 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:36.267932 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:36.268550 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.269640 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.270925 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.271696 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.271830 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.271962 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:36.272380 (+ 418us) server_negotiation.cc:299] Negotiation successful
0809 02:25:36.272501 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":91,"threads_started":1}
I20260809 02:25:36.273075 24927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.265943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:39599 (local address 127.0.0.1:47848)
0809 02:25:36.267221 (+ 1278us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:36.267236 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:36.267428 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:36.268266 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:36.268268 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:36.268283 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:36.268412 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.268421 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.269776 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.269780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.270794 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.270804 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.271839 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.271846 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.271973 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.272013 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 02:25:36.272124 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 02:25:36.272912 (+ 788us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1209,"mutex_wait_us":45,"spinlock_wait_cycles":768,"thread_start_us":117,"threads_started":1}
I20260809 02:25:36.273238 24920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.265794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:33233 (local address 127.0.0.1:48022)
0809 02:25:36.266437 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:36.266490 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:36.266622 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:36.267942 (+ 1320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:36.267948 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:36.267973 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:36.268132 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.268140 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.269590 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.269593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.271084 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.271092 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.272168 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.272174 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.272912 (+ 738us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.272937 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:25:36.273034 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 02:25:36.273103 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":734,"thread_start_us":110,"threads_started":1}
I20260809 02:25:36.273383 24924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.266009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48022 (local address 127.21.214.130:33233)
0809 02:25:36.267393 (+ 1384us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:36.267405 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:36.267429 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:25:36.267519 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:36.267523 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:36.267766 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:36.267932 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:36.268274 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.269456 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.271214 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.272036 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.272185 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.272310 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:36.273090 (+ 780us) server_negotiation.cc:299] Negotiation successful
0809 02:25:36.273192 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1268,"thread_start_us":122,"threads_started":1}
I20260809 02:25:36.273986 24923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.266967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:44939 (local address 127.0.0.1:34534)
0809 02:25:36.267303 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:36.267319 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:36.267409 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:36.268113 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:36.268115 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:36.268130 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:36.268245 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.268251 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.269422 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.269425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.271079 (+ 1654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.271092 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.272130 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.272134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.273696 (+ 1562us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.273720 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:25:36.273797 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:25:36.273863 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":706,"thread_start_us":97,"threads_started":1}
I20260809 02:25:36.274068 24928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.267197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34534 (local address 127.21.214.131:44939)
0809 02:25:36.267655 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:36.267666 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:36.267683 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:25:36.267744 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:36.267748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:36.267926 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:36.268073 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:36.268369 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.269296 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.271235 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.271791 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.271934 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.272064 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:36.273829 (+ 1765us) server_negotiation.cc:299] Negotiation successful
0809 02:25:36.273928 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":126,"threads_started":1}
I20260809 02:25:36.275972 24359 tablet_service.cc:1467] Processing CreateTablet for tablet 628fce34640341359979577affec1af5 (DEFAULT_TABLE table=test-table [id=dff9bf8ff22c46f7a20bf2aeaff6b263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:36.276166 24583 tablet_service.cc:1467] Processing CreateTablet for tablet 628fce34640341359979577affec1af5 (DEFAULT_TABLE table=test-table [id=dff9bf8ff22c46f7a20bf2aeaff6b263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:36.277022 24359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628fce34640341359979577affec1af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:36.276679 24795 tablet_service.cc:1467] Processing CreateTablet for tablet 628fce34640341359979577affec1af5 (DEFAULT_TABLE table=test-table [id=dff9bf8ff22c46f7a20bf2aeaff6b263]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:36.277192 24583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628fce34640341359979577affec1af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:36.277607 24795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628fce34640341359979577affec1af5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:36.284389 24930 tablet_bootstrap.cc:492] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a: Bootstrap starting.
I20260809 02:25:36.285238 24931 tablet_bootstrap.cc:492] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208: Bootstrap starting.
I20260809 02:25:36.285853 24933 tablet_bootstrap.cc:492] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8: Bootstrap starting.
I20260809 02:25:36.286784 24930 tablet_bootstrap.cc:654] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:36.287698 24930 log.cc:824] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:36.288051 24933 tablet_bootstrap.cc:654] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:36.288148 24931 tablet_bootstrap.cc:654] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:36.288990 24931 log.cc:824] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:36.288890 24933 log.cc:824] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:36.289940 24930 tablet_bootstrap.cc:492] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a: No bootstrap required, opened a new log
I20260809 02:25:36.290153 24930 ts_tablet_manager.cc:1397] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:25:36.291018 24931 tablet_bootstrap.cc:492] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208: No bootstrap required, opened a new log
I20260809 02:25:36.291189 24931 ts_tablet_manager.cc:1397] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:25:36.291421 24933 tablet_bootstrap.cc:492] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8: No bootstrap required, opened a new log
I20260809 02:25:36.291576 24933 ts_tablet_manager.cc:1397] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:25:36.293476 24930 raft_consensus.cc:348] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.293680 24930 raft_consensus.cc:374] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:36.293712 24930 raft_consensus.cc:729] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68cc33ad7c91433bbdcde43ba466f54a, State: Initialized, Role: FOLLOWER
I20260809 02:25:36.294124 24930 consensus_queue.cc:260] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.294785 24459 heartbeater.cc:503] Master 127.21.214.190:38251 was elected leader, sending a full tablet report...
I20260809 02:25:36.295148 24930 ts_tablet_manager.cc:1428] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:25:36.295135 24931 raft_consensus.cc:348] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.295388 24931 raft_consensus.cc:374] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:36.295435 24931 raft_consensus.cc:729] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 977d9fa061874c20a4d02f181357d208, State: Initialized, Role: FOLLOWER
I20260809 02:25:36.295288 24933 raft_consensus.cc:348] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.295495 24933 raft_consensus.cc:374] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:36.295547 24933 raft_consensus.cc:729] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cbbe01c796441959c982e8e2dfe74c8, State: Initialized, Role: FOLLOWER
I20260809 02:25:36.295835 24931 consensus_queue.cc:260] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.296377 24933 consensus_queue.cc:260] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.296783 24931 ts_tablet_manager.cc:1428] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:25:36.296887 24895 heartbeater.cc:503] Master 127.21.214.190:38251 was elected leader, sending a full tablet report...
I20260809 02:25:36.297204 24933 ts_tablet_manager.cc:1428] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:25:36.297492 24684 heartbeater.cc:503] Master 127.21.214.190:38251 was elected leader, sending a full tablet report...
W20260809 02:25:36.456804 24896 tablet.cc:2369] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:25:36.482543 24685 tablet.cc:2369] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:25:36.506279 24460 tablet.cc:2369] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:25:36.568346 24940 raft_consensus.cc:482] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:25:36.568626 24940 raft_consensus.cc:504] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.569839 24940 leader_election.cc:288] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68cc33ad7c91433bbdcde43ba466f54a (127.21.214.129:39599), 977d9fa061874c20a4d02f181357d208 (127.21.214.131:44939)
I20260809 02:25:36.573959 24926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.570330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:34443 (local address 127.21.214.129:39599)
0809 02:25:36.570511 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:36.570517 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:36.570771 (+ 254us) server_negotiation.cc:407] Connection header received
0809 02:25:36.570934 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:36.570937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:36.570988 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:36.571065 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:36.571356 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.571875 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.572951 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.573383 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.573515 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.573571 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:36.573762 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 02:25:36.573838 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:25:36.573977 24945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.570149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:39599 (local address 127.21.214.130:34443)
0809 02:25:36.570663 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:36.570677 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:36.570820 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:36.571092 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:36.571094 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:36.571109 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:36.571228 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.571233 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.572000 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.572004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.572812 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.572822 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.573514 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.573518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.573623 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.573644 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:25:36.573742 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 02:25:36.573814 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"spinlock_wait_cycles":12800,"thread_start_us":104,"threads_started":1}
I20260809 02:25:36.574496 24928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.570429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:56993 (local address 127.21.214.131:44939)
0809 02:25:36.570582 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:36.570593 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:36.570808 (+ 215us) server_negotiation.cc:407] Connection header received
0809 02:25:36.571201 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:36.571203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:36.571246 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:36.571347 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:36.571670 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.572213 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.573304 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.573766 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.573915 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.573969 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:36.574221 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 02:25:36.574329 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:25:36.574723 24384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628fce34640341359979577affec1af5" candidate_uuid: "9cbbe01c796441959c982e8e2dfe74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68cc33ad7c91433bbdcde43ba466f54a" is_pre_election: true
I20260809 02:25:36.574920 24942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.570149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:44939 (local address 127.21.214.130:56993)
0809 02:25:36.570656 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:36.570672 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:36.570820 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:36.571367 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:36.571371 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:36.571391 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:36.571516 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.571521 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.572346 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.572350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.573162 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:36.573172 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.573910 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.573915 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:36.574027 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.574058 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 02:25:36.574657 (+ 599us) client_negotiation.cc:240] Negotiation successful
0809 02:25:36.574754 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"mutex_wait_us":174,"spinlock_wait_cycles":23552,"thread_start_us":93,"threads_started":1}
I20260809 02:25:36.575100 24384 raft_consensus.cc:2454] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cbbe01c796441959c982e8e2dfe74c8 in term 0.
I20260809 02:25:36.575596 24824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628fce34640341359979577affec1af5" candidate_uuid: "9cbbe01c796441959c982e8e2dfe74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "977d9fa061874c20a4d02f181357d208" is_pre_election: true
I20260809 02:25:36.575718 24496 leader_election.cc:302] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68cc33ad7c91433bbdcde43ba466f54a, 9cbbe01c796441959c982e8e2dfe74c8; no voters:
I20260809 02:25:36.575933 24824 raft_consensus.cc:2454] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cbbe01c796441959c982e8e2dfe74c8 in term 0.
I20260809 02:25:36.576063 24940 raft_consensus.cc:2781] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:25:36.576166 24940 raft_consensus.cc:482] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:25:36.576228 24940 raft_consensus.cc:3037] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:36.577368 24940 raft_consensus.cc:504] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.577713 24940 leader_election.cc:288] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [CANDIDATE]: Term 1 election: Requested vote from peers 68cc33ad7c91433bbdcde43ba466f54a (127.21.214.129:39599), 977d9fa061874c20a4d02f181357d208 (127.21.214.131:44939)
I20260809 02:25:36.578094 24824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628fce34640341359979577affec1af5" candidate_uuid: "9cbbe01c796441959c982e8e2dfe74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "977d9fa061874c20a4d02f181357d208"
I20260809 02:25:36.578078 24384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628fce34640341359979577affec1af5" candidate_uuid: "9cbbe01c796441959c982e8e2dfe74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68cc33ad7c91433bbdcde43ba466f54a"
I20260809 02:25:36.578213 24824 raft_consensus.cc:3037] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:36.578258 24384 raft_consensus.cc:3037] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:36.579698 24384 raft_consensus.cc:2454] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cbbe01c796441959c982e8e2dfe74c8 in term 1.
I20260809 02:25:36.580101 24496 leader_election.cc:302] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68cc33ad7c91433bbdcde43ba466f54a, 9cbbe01c796441959c982e8e2dfe74c8; no voters:
I20260809 02:25:36.580147 24824 raft_consensus.cc:2454] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cbbe01c796441959c982e8e2dfe74c8 in term 1.
I20260809 02:25:36.580367 24940 raft_consensus.cc:2781] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:36.580735 24940 raft_consensus.cc:686] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [term 1 LEADER]: Becoming Leader. State: Replica: 9cbbe01c796441959c982e8e2dfe74c8, State: Running, Role: LEADER
I20260809 02:25:36.581116 24940 consensus_queue.cc:237] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.584594 24146 catalog_manager.cc:5495] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cbbe01c796441959c982e8e2dfe74c8 (127.21.214.130). New cstate: current_term: 1 leader_uuid: "9cbbe01c796441959c982e8e2dfe74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } health_report { overall_health: UNKNOWN } } }
I20260809 02:25:36.641201 24924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:36.637300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48038 (local address 127.21.214.130:33233)
0809 02:25:36.637454 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:36.637458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:36.637472 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:25:36.637553 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:36.637556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:36.637617 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:36.637717 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:36.638011 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.638568 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.639574 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:36.639793 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:36.639872 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:36.640379 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:36.640791 (+ 412us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:36.640882 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:36.641028 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 02:25:36.641088 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 02:25:36.647068 24384 raft_consensus.cc:1261] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a [term 1 FOLLOWER]: Refusing update from remote peer 9cbbe01c796441959c982e8e2dfe74c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:36.647075 24824 raft_consensus.cc:1261] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208 [term 1 FOLLOWER]: Refusing update from remote peer 9cbbe01c796441959c982e8e2dfe74c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:36.647897 24946 consensus_queue.cc:1035] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:36.648093 24940 consensus_queue.cc:1035] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:36.655617 24953 mvcc.cc:205] Tried to move back new op lower bound from 7316448610899214336 to 7316448610639216640. Current Snapshot: MvccSnapshot[applied={T|T < 7316448610899214336}]
I20260809 02:25:36.655793 24952 mvcc.cc:205] Tried to move back new op lower bound from 7316448610899214336 to 7316448610639216640. Current Snapshot: MvccSnapshot[applied={T|T < 7316448610899214336}]
I20260809 02:25:36.659925 24951 mvcc.cc:205] Tried to move back new op lower bound from 7316448610899214336 to 7316448610639216640. Current Snapshot: MvccSnapshot[applied={T|T < 7316448610899214336 or (T in {7316448610899214336})}]
I20260809 02:25:36.666273 24148 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:36.666486 24148 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:36.668773 24148 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952: Sending DeleteTablet for 3 replicas of tablet 628fce34640341359979577affec1af5
I20260809 02:25:36.669543 24359 tablet_service.cc:1514] Processing DeleteTablet for tablet 628fce34640341359979577affec1af5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:36 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:47848
I20260809 02:25:36.669633 24583 tablet_service.cc:1514] Processing DeleteTablet for tablet 628fce34640341359979577affec1af5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:36 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:48022
I20260809 02:25:36.670110 24970 tablet_replica.cc:330] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a: stopping tablet replica
I20260809 02:25:36.670135 24795 tablet_service.cc:1514] Processing DeleteTablet for tablet 628fce34640341359979577affec1af5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:36 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:34534
I20260809 02:25:36.670226 24971 tablet_replica.cc:330] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8: stopping tablet replica
I20260809 02:25:36.670567 24971 raft_consensus.cc:2229] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:25:36.670593 24970 raft_consensus.cc:2229] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:36.670948 24971 raft_consensus.cc:2258] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:36.670981 24970 raft_consensus.cc:2258] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:36.671422 24974 tablet_replica.cc:330] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208: stopping tablet replica
I20260809 02:25:36.671404 24148 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35054:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 02:25:36.671697 24974 raft_consensus.cc:2229] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260809 02:25:36.671823 24148 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:25:36.671999 24974 raft_consensus.cc:2258] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:36.673059 24970 ts_tablet_manager.cc:1905] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:36.673511 24974 ts_tablet_manager.cc:1905] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:36.674091 24971 ts_tablet_manager.cc:1905] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:36.676378 24974 ts_tablet_manager.cc:1918] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:25:36.676477 24974 log.cc:1196] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/628fce34640341359979577affec1af5
I20260809 02:25:36.676801 24974 ts_tablet_manager.cc:1939] T 628fce34640341359979577affec1af5 P 977d9fa061874c20a4d02f181357d208: Deleting consensus metadata
I20260809 02:25:36.676962 24971 ts_tablet_manager.cc:1918] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:25:36.677052 24971 log.cc:1196] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/628fce34640341359979577affec1af5
I20260809 02:25:36.677376 24971 ts_tablet_manager.cc:1939] T 628fce34640341359979577affec1af5 P 9cbbe01c796441959c982e8e2dfe74c8: Deleting consensus metadata
I20260809 02:25:36.678458 24359 tablet_service.cc:1467] Processing CreateTablet for tablet 77ff0874081d4a8f875593b43a49afd2 (DEFAULT_TABLE table=test-table [id=331f758990274363a32804a28f467f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:36.678511 24583 tablet_service.cc:1467] Processing CreateTablet for tablet 77ff0874081d4a8f875593b43a49afd2 (DEFAULT_TABLE table=test-table [id=331f758990274363a32804a28f467f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:36.678761 24583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77ff0874081d4a8f875593b43a49afd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:36.679098 24359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77ff0874081d4a8f875593b43a49afd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:36.681182 24795 tablet_service.cc:1467] Processing CreateTablet for tablet 77ff0874081d4a8f875593b43a49afd2 (DEFAULT_TABLE table=test-table [id=331f758990274363a32804a28f467f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:36.681324 24970 ts_tablet_manager.cc:1918] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:25:36.681444 24970 log.cc:1196] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/wal/wals/628fce34640341359979577affec1af5
I20260809 02:25:36.681450 24795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77ff0874081d4a8f875593b43a49afd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:36.681569 24933 tablet_bootstrap.cc:492] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8: Bootstrap starting.
I20260809 02:25:36.681838 24970 ts_tablet_manager.cc:1939] T 628fce34640341359979577affec1af5 P 68cc33ad7c91433bbdcde43ba466f54a: Deleting consensus metadata
I20260809 02:25:36.682550 24930 tablet_bootstrap.cc:492] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a: Bootstrap starting.
I20260809 02:25:36.683517 24933 tablet_bootstrap.cc:654] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:36.683517 24930 tablet_bootstrap.cc:654] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:36.684674 24126 catalog_manager.cc:4841] TS 68cc33ad7c91433bbdcde43ba466f54a (127.21.214.129:39599): tablet 628fce34640341359979577affec1af5 (table test-table [id=dff9bf8ff22c46f7a20bf2aeaff6b263]) successfully deleted
I20260809 02:25:36.685099 24933 tablet_bootstrap.cc:492] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8: No bootstrap required, opened a new log
I20260809 02:25:36.685184 24933 ts_tablet_manager.cc:1397] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 02:25:36.685389 24131 catalog_manager.cc:4841] TS 9cbbe01c796441959c982e8e2dfe74c8 (127.21.214.130:33233): tablet 628fce34640341359979577affec1af5 (table test-table [id=dff9bf8ff22c46f7a20bf2aeaff6b263]) successfully deleted
I20260809 02:25:36.685731 24933 raft_consensus.cc:348] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.685874 24933 raft_consensus.cc:374] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:36.685915 24933 raft_consensus.cc:729] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cbbe01c796441959c982e8e2dfe74c8, State: Initialized, Role: FOLLOWER
I20260809 02:25:36.686532 24931 tablet_bootstrap.cc:492] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208: Bootstrap starting.
I20260809 02:25:36.686918 24930 tablet_bootstrap.cc:492] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a: No bootstrap required, opened a new log
I20260809 02:25:36.687028 24930 ts_tablet_manager.cc:1397] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 02:25:36.687443 24930 raft_consensus.cc:348] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.687502 24931 tablet_bootstrap.cc:654] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:36.687562 24930 raft_consensus.cc:374] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:36.687604 24930 raft_consensus.cc:729] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68cc33ad7c91433bbdcde43ba466f54a, State: Initialized, Role: FOLLOWER
I20260809 02:25:36.687743 24930 consensus_queue.cc:260] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.688023 24930 ts_tablet_manager.cc:1428] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:25:36.688292 24933 consensus_queue.cc:260] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.688606 24131 catalog_manager.cc:4841] TS 977d9fa061874c20a4d02f181357d208 (127.21.214.131:44939): tablet 628fce34640341359979577affec1af5 (table test-table [id=dff9bf8ff22c46f7a20bf2aeaff6b263]) successfully deleted
I20260809 02:25:36.689428 24933 ts_tablet_manager.cc:1428] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260809 02:25:36.689893 24931 tablet_bootstrap.cc:492] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208: No bootstrap required, opened a new log
I20260809 02:25:36.689980 24931 ts_tablet_manager.cc:1397] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:25:36.690449 24931 raft_consensus.cc:348] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.690564 24931 raft_consensus.cc:374] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:36.690600 24931 raft_consensus.cc:729] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 977d9fa061874c20a4d02f181357d208, State: Initialized, Role: FOLLOWER
I20260809 02:25:36.690721 24931 consensus_queue.cc:260] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:36.690975 24931 ts_tablet_manager.cc:1428] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:25:37.023254 24937 raft_consensus.cc:482] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:25:37.023450 24937 raft_consensus.cc:504] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:37.024644 24937 leader_election.cc:288] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9cbbe01c796441959c982e8e2dfe74c8 (127.21.214.130:33233), 977d9fa061874c20a4d02f181357d208 (127.21.214.131:44939)
I20260809 02:25:37.030622 24928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.025502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:33381 (local address 127.21.214.131:44939)
0809 02:25:37.025684 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:37.025688 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:37.025801 (+ 113us) server_negotiation.cc:407] Connection header received
0809 02:25:37.025892 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:37.025898 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:37.025957 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:37.026042 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:37.026280 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.027213 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.029189 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.029879 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.030027 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.030088 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:37.030366 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 02:25:37.030486 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:25:37.030622 24924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.025121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:54273 (local address 127.21.214.130:33233)
0809 02:25:37.025310 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:37.025315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:37.025436 (+ 121us) server_negotiation.cc:407] Connection header received
0809 02:25:37.025794 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:37.025797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:37.025865 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:37.025956 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:37.026278 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.027173 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.029189 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.029887 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.030027 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.030088 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:37.030366 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 02:25:37.030474 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 02:25:37.030650 24981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.025342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:44939 (local address 127.21.214.129:33381)
0809 02:25:37.025707 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:37.025718 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:37.025811 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:37.026058 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:37.026061 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:37.026073 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:37.026160 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:37.026168 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.027391 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.027398 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:37.029012 (+ 1614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:37.029025 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.030035 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.030039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:37.030234 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.030255 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:25:37.030324 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 02:25:37.030463 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":243,"thread_start_us":103,"threads_started":1}
I20260809 02:25:37.030705 24979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.024934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:33233 (local address 127.21.214.129:54273)
0809 02:25:37.025309 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:37.025327 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:37.025481 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:37.025974 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:37.025976 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:37.025990 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:37.026126 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:37.026135 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.027411 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.027413 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:37.029017 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:37.029025 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.030035 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.030039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:37.030193 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.030222 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 02:25:37.030322 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 02:25:37.030460 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":188,"thread_start_us":94,"threads_started":1}
I20260809 02:25:37.031215 24824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ff0874081d4a8f875593b43a49afd2" candidate_uuid: "68cc33ad7c91433bbdcde43ba466f54a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "977d9fa061874c20a4d02f181357d208" is_pre_election: true
I20260809 02:25:37.031370 24824 raft_consensus.cc:2454] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68cc33ad7c91433bbdcde43ba466f54a in term 0.
I20260809 02:25:37.031477 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ff0874081d4a8f875593b43a49afd2" candidate_uuid: "68cc33ad7c91433bbdcde43ba466f54a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cbbe01c796441959c982e8e2dfe74c8" is_pre_election: true
I20260809 02:25:37.031751 24292 leader_election.cc:302] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68cc33ad7c91433bbdcde43ba466f54a, 977d9fa061874c20a4d02f181357d208; no voters:
I20260809 02:25:37.031757 24609 raft_consensus.cc:2454] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 68cc33ad7c91433bbdcde43ba466f54a in term 0.
I20260809 02:25:37.032079 24937 raft_consensus.cc:2781] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:25:37.032168 24937 raft_consensus.cc:482] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:25:37.032250 24937 raft_consensus.cc:3037] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:37.033368 24937 raft_consensus.cc:504] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:37.033744 24937 leader_election.cc:288] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [CANDIDATE]: Term 1 election: Requested vote from peers 9cbbe01c796441959c982e8e2dfe74c8 (127.21.214.130:33233), 977d9fa061874c20a4d02f181357d208 (127.21.214.131:44939)
I20260809 02:25:37.034219 24609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ff0874081d4a8f875593b43a49afd2" candidate_uuid: "68cc33ad7c91433bbdcde43ba466f54a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cbbe01c796441959c982e8e2dfe74c8"
I20260809 02:25:37.034373 24609 raft_consensus.cc:3037] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:37.034364 24824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77ff0874081d4a8f875593b43a49afd2" candidate_uuid: "68cc33ad7c91433bbdcde43ba466f54a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "977d9fa061874c20a4d02f181357d208"
I20260809 02:25:37.034547 24824 raft_consensus.cc:3037] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:37.035529 24824 raft_consensus.cc:2454] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68cc33ad7c91433bbdcde43ba466f54a in term 1.
I20260809 02:25:37.035557 24609 raft_consensus.cc:2454] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 68cc33ad7c91433bbdcde43ba466f54a in term 1.
I20260809 02:25:37.035821 24292 leader_election.cc:302] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68cc33ad7c91433bbdcde43ba466f54a, 977d9fa061874c20a4d02f181357d208; no voters:
I20260809 02:25:37.036036 24937 raft_consensus.cc:2781] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:37.036314 24937 raft_consensus.cc:686] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [term 1 LEADER]: Becoming Leader. State: Replica: 68cc33ad7c91433bbdcde43ba466f54a, State: Running, Role: LEADER
I20260809 02:25:37.036584 24937 consensus_queue.cc:237] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:37.038954 24146 catalog_manager.cc:5495] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a reported cstate change: term changed from 0 to 1, leader changed from <none> to 68cc33ad7c91433bbdcde43ba466f54a (127.21.214.129). New cstate: current_term: 1 leader_uuid: "68cc33ad7c91433bbdcde43ba466f54a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } health_report { overall_health: UNKNOWN } } }
Aug 09 02:25:37 dist-test-slave-68xk krb5kdc[24082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242335, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:37.077414 24997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.068242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35066 (local address 127.21.214.190:38251)
0809 02:25:37.068591 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:37.068602 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:37.068711 (+ 109us) server_negotiation.cc:407] Connection header received
0809 02:25:37.068910 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:37.068913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:37.068951 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:37.069094 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:37.069839 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.070380 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.071248 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.071474 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.071564 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.073924 (+ 2360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:37.073927 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:37.073929 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:37.073949 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:37.075646 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:37.076134 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:37.076139 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:37.076141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:37.076222 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:37.076505 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:37.076508 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:37.076510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:37.076685 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:37.076796 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:37.077094 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 02:25:37.077264 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":289,"thread_start_us":97,"threads_started":1}
I20260809 02:25:37.077414 24996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.068126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:38251 (local address 127.0.0.1:35066)
0809 02:25:37.068602 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:37.068619 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:37.068781 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:37.069111 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:37.069114 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:37.069564 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:37.069682 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:37.069689 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.070557 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.070560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:37.071128 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:37.071136 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.071585 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.071587 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:37.071653 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.072281 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:37.072293 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:37.073782 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:37.075774 (+ 1992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:37.075786 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:37.075792 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:37.076028 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:37.076315 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:37.076319 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:37.076321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:37.076406 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:37.076796 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:37.076804 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:37.076918 (+ 114us) client_negotiation.cc:769] Sending connection context
0809 02:25:37.077040 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 02:25:37.077202 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":150,"threads_started":1}
I20260809 02:25:37.082335 24146 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:35066:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 02:25:37.083324 24146 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:25:37.088863 24359 tablet_service.cc:1467] Processing CreateTablet for tablet 3bcad8bf3de34e589b567eb6e54d29a8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bebdd2f02c5a49d78184bd83e1fd2793]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:25:37.089005 24583 tablet_service.cc:1467] Processing CreateTablet for tablet 3bcad8bf3de34e589b567eb6e54d29a8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bebdd2f02c5a49d78184bd83e1fd2793]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:25:37.089054 24795 tablet_service.cc:1467] Processing CreateTablet for tablet 3bcad8bf3de34e589b567eb6e54d29a8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bebdd2f02c5a49d78184bd83e1fd2793]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:25:37.089320 24359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bcad8bf3de34e589b567eb6e54d29a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:37.089421 24795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bcad8bf3de34e589b567eb6e54d29a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:37.089457 24583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bcad8bf3de34e589b567eb6e54d29a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:37.092342 24930 tablet_bootstrap.cc:492] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a: Bootstrap starting.
I20260809 02:25:37.092342 24931 tablet_bootstrap.cc:492] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208: Bootstrap starting.
I20260809 02:25:37.092355 24933 tablet_bootstrap.cc:492] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8: Bootstrap starting.
I20260809 02:25:37.093158 24933 tablet_bootstrap.cc:654] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:37.093348 24930 tablet_bootstrap.cc:654] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:37.093348 24931 tablet_bootstrap.cc:654] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:37.094743 24933 tablet_bootstrap.cc:492] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8: No bootstrap required, opened a new log
I20260809 02:25:37.094852 24933 ts_tablet_manager.cc:1397] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:25:37.094971 24930 tablet_bootstrap.cc:492] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a: No bootstrap required, opened a new log
I20260809 02:25:37.095024 24931 tablet_bootstrap.cc:492] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208: No bootstrap required, opened a new log
I20260809 02:25:37.095072 24930 ts_tablet_manager.cc:1397] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:25:37.095109 24931 ts_tablet_manager.cc:1397] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:25:37.095315 24933 raft_consensus.cc:348] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:37.095439 24933 raft_consensus.cc:374] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:37.095475 24933 raft_consensus.cc:729] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cbbe01c796441959c982e8e2dfe74c8, State: Initialized, Role: FOLLOWER
I20260809 02:25:37.095520 24930 raft_consensus.cc:348] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:37.095582 24931 raft_consensus.cc:348] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:37.095613 24933 consensus_queue.cc:260] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:37.095675 24930 raft_consensus.cc:374] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:37.095683 24931 raft_consensus.cc:374] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:37.095718 24930 raft_consensus.cc:729] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68cc33ad7c91433bbdcde43ba466f54a, State: Initialized, Role: FOLLOWER
I20260809 02:25:37.095721 24931 raft_consensus.cc:729] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 977d9fa061874c20a4d02f181357d208, State: Initialized, Role: FOLLOWER
I20260809 02:25:37.095849 24931 consensus_queue.cc:260] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:37.095855 24930 consensus_queue.cc:260] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:37.095947 24933 ts_tablet_manager.cc:1428] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:25:37.095899 24957 tablet_replica.cc:439] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } } }
I20260809 02:25:37.096032 24957 tablet_replica.cc:442] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:37.096103 24931 ts_tablet_manager.cc:1428] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:25:37.096153 24930 ts_tablet_manager.cc:1428] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:25:37.096359 24937 tablet_replica.cc:439] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } } }
I20260809 02:25:37.096485 24937 tablet_replica.cc:442] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:37.096715 24938 tablet_replica.cc:439] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } } }
I20260809 02:25:37.096892 24938 tablet_replica.cc:442] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:37.310236 24957 raft_consensus.cc:482] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:25:37.310403 24957 raft_consensus.cc:504] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:37.311151 24957 leader_election.cc:288] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68cc33ad7c91433bbdcde43ba466f54a (127.21.214.129:39599), 977d9fa061874c20a4d02f181357d208 (127.21.214.131:44939)
I20260809 02:25:37.311671 24824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bcad8bf3de34e589b567eb6e54d29a8" candidate_uuid: "9cbbe01c796441959c982e8e2dfe74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "977d9fa061874c20a4d02f181357d208" is_pre_election: true
I20260809 02:25:37.311667 24384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bcad8bf3de34e589b567eb6e54d29a8" candidate_uuid: "9cbbe01c796441959c982e8e2dfe74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68cc33ad7c91433bbdcde43ba466f54a" is_pre_election: true
I20260809 02:25:37.311822 24824 raft_consensus.cc:2454] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cbbe01c796441959c982e8e2dfe74c8 in term 0.
I20260809 02:25:37.311866 24384 raft_consensus.cc:2454] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cbbe01c796441959c982e8e2dfe74c8 in term 0.
I20260809 02:25:37.312248 24499 leader_election.cc:302] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 977d9fa061874c20a4d02f181357d208, 9cbbe01c796441959c982e8e2dfe74c8; no voters:
I20260809 02:25:37.312450 24957 raft_consensus.cc:2781] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:25:37.312517 24957 raft_consensus.cc:482] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:25:37.312574 24957 raft_consensus.cc:3037] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:37.313695 24957 raft_consensus.cc:504] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:37.314074 24957 leader_election.cc:288] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [CANDIDATE]: Term 1 election: Requested vote from peers 68cc33ad7c91433bbdcde43ba466f54a (127.21.214.129:39599), 977d9fa061874c20a4d02f181357d208 (127.21.214.131:44939)
I20260809 02:25:37.314494 24824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bcad8bf3de34e589b567eb6e54d29a8" candidate_uuid: "9cbbe01c796441959c982e8e2dfe74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "977d9fa061874c20a4d02f181357d208"
I20260809 02:25:37.314550 24384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bcad8bf3de34e589b567eb6e54d29a8" candidate_uuid: "9cbbe01c796441959c982e8e2dfe74c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68cc33ad7c91433bbdcde43ba466f54a"
I20260809 02:25:37.314656 24824 raft_consensus.cc:3037] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:37.314667 24384 raft_consensus.cc:3037] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:37.315625 24384 raft_consensus.cc:2454] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cbbe01c796441959c982e8e2dfe74c8 in term 1.
I20260809 02:25:37.315796 24824 raft_consensus.cc:2454] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cbbe01c796441959c982e8e2dfe74c8 in term 1.
I20260809 02:25:37.315929 24496 leader_election.cc:302] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 68cc33ad7c91433bbdcde43ba466f54a, 9cbbe01c796441959c982e8e2dfe74c8; no voters:
I20260809 02:25:37.316128 24957 raft_consensus.cc:2781] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:37.316332 24957 raft_consensus.cc:686] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [term 1 LEADER]: Becoming Leader. State: Replica: 9cbbe01c796441959c982e8e2dfe74c8, State: Running, Role: LEADER
I20260809 02:25:37.316542 24957 consensus_queue.cc:237] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } }
I20260809 02:25:37.317268 25004 tablet_replica.cc:439] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8: TxnStatusTablet state changed. Reason: New leader 9cbbe01c796441959c982e8e2dfe74c8. Latest consensus state: current_term: 1 leader_uuid: "9cbbe01c796441959c982e8e2dfe74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } } }
I20260809 02:25:37.317391 25004 tablet_replica.cc:442] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:25:37.317735 25007 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 02:25:37.317937 25007 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 02:25:37.318377 24146 catalog_manager.cc:5495] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cbbe01c796441959c982e8e2dfe74c8 (127.21.214.130). New cstate: current_term: 1 leader_uuid: "9cbbe01c796441959c982e8e2dfe74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } health_report { overall_health: UNKNOWN } } }
I20260809 02:25:37.340081 24924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.336253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48040 (local address 127.21.214.130:33233)
0809 02:25:37.336415 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:37.336420 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:37.336528 (+ 108us) server_negotiation.cc:407] Connection header received
0809 02:25:37.336767 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:37.336770 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:37.336822 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:37.336911 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:37.337196 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.337756 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.338829 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.339096 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.339224 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.339542 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:37.339623 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:37.339714 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:37.339869 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 02:25:37.339923 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 02:25:37.340081 24996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.336137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:33233 (local address 127.0.0.1:48040)
0809 02:25:37.336433 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:37.336451 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:37.336604 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:37.336934 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:37.336938 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:37.336945 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:25:37.337065 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:37.337076 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.337880 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.337884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:37.338697 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:37.338708 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.339227 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.339231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:37.339336 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.339383 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:25:37.339727 (+ 344us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:25:37.339746 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 02:25:37.339823 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:25:37.339922 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179}
I20260809 02:25:37.343217 24824 raft_consensus.cc:1261] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208 [term 1 FOLLOWER]: Refusing update from remote peer 9cbbe01c796441959c982e8e2dfe74c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:37.343238 24384 raft_consensus.cc:1261] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a [term 1 FOLLOWER]: Refusing update from remote peer 9cbbe01c796441959c982e8e2dfe74c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:37.343657 25004 consensus_queue.cc:1035] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:37.343809 24957 consensus_queue.cc:1035] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:37.345294 24938 tablet_replica.cc:439] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208: TxnStatusTablet state changed. Reason: New leader 9cbbe01c796441959c982e8e2dfe74c8. Latest consensus state: current_term: 1 leader_uuid: "9cbbe01c796441959c982e8e2dfe74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } } }
I20260809 02:25:37.345417 24938 tablet_replica.cc:442] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:37.346231 24937 tablet_replica.cc:439] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a: TxnStatusTablet state changed. Reason: New leader 9cbbe01c796441959c982e8e2dfe74c8. Latest consensus state: current_term: 1 leader_uuid: "9cbbe01c796441959c982e8e2dfe74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } } }
I20260809 02:25:37.346344 24937 tablet_replica.cc:442] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:37.347736 25004 tablet_replica.cc:439] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9cbbe01c796441959c982e8e2dfe74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } } }
I20260809 02:25:37.347869 25004 tablet_replica.cc:442] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:25:37.348479 24957 tablet_replica.cc:439] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9cbbe01c796441959c982e8e2dfe74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } } }
I20260809 02:25:37.348590 24957 tablet_replica.cc:442] T 3bcad8bf3de34e589b567eb6e54d29a8 P 9cbbe01c796441959c982e8e2dfe74c8: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:25:37.348745 24938 tablet_replica.cc:439] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9cbbe01c796441959c982e8e2dfe74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } } }
I20260809 02:25:37.348850 24938 tablet_replica.cc:442] T 3bcad8bf3de34e589b567eb6e54d29a8 P 977d9fa061874c20a4d02f181357d208: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:37.349699 24937 tablet_replica.cc:439] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9cbbe01c796441959c982e8e2dfe74c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "68cc33ad7c91433bbdcde43ba466f54a" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39599 } } peers { permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 } } peers { permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 } } }
I20260809 02:25:37.349809 24937 tablet_replica.cc:442] T 3bcad8bf3de34e589b567eb6e54d29a8 P 68cc33ad7c91433bbdcde43ba466f54a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:37.360196 25028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.355560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47850 (local address 127.21.214.129:39599)
0809 02:25:37.355811 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:37.355815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:37.355929 (+ 114us) server_negotiation.cc:407] Connection header received
0809 02:25:37.356115 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:37.356118 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:37.356197 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:37.356316 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:37.356614 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.357247 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.358500 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.358762 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.358849 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.359162 (+ 313us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:37.359670 (+ 508us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:37.359816 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:37.359887 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 02:25:37.359941 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":94,"threads_started":1}
I20260809 02:25:37.372246 25034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.368294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:33233 (local address 127.21.214.129:57063)
0809 02:25:37.368730 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:37.368744 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:37.368882 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:37.369178 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:37.369181 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:37.369190 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:25:37.369343 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:37.369349 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.370157 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.370161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:37.370922 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:37.370932 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.371419 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.371423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:37.371533 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.371579 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:25:37.371908 (+ 329us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:25:37.371918 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 02:25:37.371990 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:25:37.372078 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":126,"threads_started":1}
I20260809 02:25:37.372218 24924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.368411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:57063 (local address 127.21.214.130:33233)
0809 02:25:37.368570 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:37.368578 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:37.368824 (+ 246us) server_negotiation.cc:407] Connection header received
0809 02:25:37.369013 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:37.369017 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:37.369069 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:37.369167 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:37.369463 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.370025 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.371055 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.371296 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.371414 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.371739 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:37.371814 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:37.371902 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:37.371999 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 02:25:37.372055 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:25:37.379897 24824 raft_consensus.cc:1261] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208 [term 1 FOLLOWER]: Refusing update from remote peer 68cc33ad7c91433bbdcde43ba466f54a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:37.380275 24609 raft_consensus.cc:1261] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8 [term 1 FOLLOWER]: Refusing update from remote peer 68cc33ad7c91433bbdcde43ba466f54a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:37.380385 24984 consensus_queue.cc:1035] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [LEADER]: Connected to new peer: Peer: permanent_uuid: "977d9fa061874c20a4d02f181357d208" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 44939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:37.380950 24984 consensus_queue.cc:1035] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cbbe01c796441959c982e8e2dfe74c8" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:37.403756 25028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.399828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:52523 (local address 127.21.214.129:39599)
0809 02:25:37.399952 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:37.399958 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:37.400233 (+ 275us) server_negotiation.cc:407] Connection header received
0809 02:25:37.400356 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:37.400359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:37.400411 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:37.400496 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:37.400740 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.401519 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.402623 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.402977 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.403086 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.403329 (+ 243us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:37.403413 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:37.403484 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:37.403562 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 02:25:37.403616 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:25:37.403769 25041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.399741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:39599 (local address 127.21.214.130:52523)
0809 02:25:37.400137 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:37.400149 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:37.400243 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:37.400498 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:37.400500 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:37.400506 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:25:37.400630 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:37.400636 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.401638 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.401641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:37.402499 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:37.402512 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.403090 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.403093 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:37.403157 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.403203 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:25:37.403498 (+ 295us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:25:37.403503 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:25:37.403552 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 02:25:37.403621 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":99,"threads_started":1}
I20260809 02:25:37.429332 24148 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:37.429517 24148 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:37.431924 24148 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9d31f2e7ba024098902030d2bab0d952: Sending DeleteTablet for 3 replicas of tablet 77ff0874081d4a8f875593b43a49afd2
I20260809 02:25:37.432472 24359 tablet_service.cc:1514] Processing DeleteTablet for tablet 77ff0874081d4a8f875593b43a49afd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:37 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:47848
I20260809 02:25:37.432807 24795 tablet_service.cc:1514] Processing DeleteTablet for tablet 77ff0874081d4a8f875593b43a49afd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:37 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:34534
I20260809 02:25:37.432866 24583 tablet_service.cc:1514] Processing DeleteTablet for tablet 77ff0874081d4a8f875593b43a49afd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:37 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:48022
I20260809 02:25:37.433295 25049 tablet_replica.cc:330] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8: stopping tablet replica
I20260809 02:25:37.433490 25049 raft_consensus.cc:2229] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:37.433670 25049 raft_consensus.cc:2258] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:37.434520 25047 tablet_replica.cc:330] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a: stopping tablet replica
I20260809 02:25:37.434670 25047 raft_consensus.cc:2229] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:25:37.434672 25049 ts_tablet_manager.cc:1905] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:37.434979 25047 raft_consensus.cc:2258] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:37.435685 25047 ts_tablet_manager.cc:1905] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:37.438241 25049 ts_tablet_manager.cc:1918] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:25:37.438385 25049 log.cc:1196] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/77ff0874081d4a8f875593b43a49afd2
I20260809 02:25:37.438689 25047 ts_tablet_manager.cc:1918] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:25:37.438777 25047 log.cc:1196] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-0/wal/wals/77ff0874081d4a8f875593b43a49afd2
I20260809 02:25:37.438926 25049 ts_tablet_manager.cc:1939] T 77ff0874081d4a8f875593b43a49afd2 P 9cbbe01c796441959c982e8e2dfe74c8: Deleting consensus metadata
I20260809 02:25:37.439064 25047 ts_tablet_manager.cc:1939] T 77ff0874081d4a8f875593b43a49afd2 P 68cc33ad7c91433bbdcde43ba466f54a: Deleting consensus metadata
I20260809 02:25:37.439790 24131 catalog_manager.cc:4841] TS 9cbbe01c796441959c982e8e2dfe74c8 (127.21.214.130:33233): tablet 77ff0874081d4a8f875593b43a49afd2 (table test-table [id=331f758990274363a32804a28f467f3d]) successfully deleted
I20260809 02:25:37.439937 24126 catalog_manager.cc:4841] TS 68cc33ad7c91433bbdcde43ba466f54a (127.21.214.129:39599): tablet 77ff0874081d4a8f875593b43a49afd2 (table test-table [id=331f758990274363a32804a28f467f3d]) successfully deleted
I20260809 02:25:37.440105 25050 tablet_replica.cc:330] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208: stopping tablet replica
I20260809 02:25:37.440251 25050 raft_consensus.cc:2229] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:37.440382 25050 raft_consensus.cc:2258] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:37.441592 25050 ts_tablet_manager.cc:1905] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:37.444610 25050 ts_tablet_manager.cc:1918] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:25:37.444756 25050 log.cc:1196] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/77ff0874081d4a8f875593b43a49afd2
I20260809 02:25:37.445107 25050 ts_tablet_manager.cc:1939] T 77ff0874081d4a8f875593b43a49afd2 P 977d9fa061874c20a4d02f181357d208: Deleting consensus metadata
I20260809 02:25:37.445881 24131 catalog_manager.cc:4841] TS 977d9fa061874c20a4d02f181357d208 (127.21.214.131:44939): tablet 77ff0874081d4a8f875593b43a49afd2 (table test-table [id=331f758990274363a32804a28f467f3d]) successfully deleted
Aug 09 02:25:37 dist-test-slave-68xk krb5kdc[24082](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242336, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.214.129@KRBTEST.COM
I20260809 02:25:37.454453 25028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.440923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47862 (local address 127.21.214.129:39599)
0809 02:25:37.441059 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:37.441064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:37.441472 (+ 408us) server_negotiation.cc:407] Connection header received
0809 02:25:37.441707 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:37.441710 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:37.441770 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:37.441827 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:37.442884 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.443701 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.444928 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.445306 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.445396 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.449550 (+ 4154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:37.449563 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:37.449579 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:37.449609 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:37.452013 (+ 2404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:37.452591 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:37.452598 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:37.452600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:37.452710 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:37.453309 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:37.453313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:37.453314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:37.453658 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:37.453899 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:37.454114 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 02:25:37.454250 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 02:25:37.455042 24443 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47862
I20260809 02:25:37.468674 24997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:37.459247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35068 (local address 127.21.214.190:38251)
0809 02:25:37.459382 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:37.459387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:37.459747 (+ 360us) server_negotiation.cc:407] Connection header received
0809 02:25:37.459984 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:37.459988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:37.460041 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:37.460097 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:37.461130 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.461955 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.463162 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:37.463507 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:37.463585 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:37.465307 (+ 1722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:37.465310 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:37.465313 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:37.465337 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:37.466948 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:37.467401 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:37.467405 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:37.467407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:37.467487 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:37.467769 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:37.467772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:37.467774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:37.467966 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:37.468064 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:37.468387 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 02:25:37.468510 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 02:25:37.469394 24148 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35068
I20260809 02:25:37.471338 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 24266
I20260809 02:25:37.489490 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 24470
I20260809 02:25:37.500696 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 24698
I20260809 02:25:37.517892 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 24101
2026-08-09T02:25:37Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3653 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:37 dist-test-slave-68xk krb5kdc[25058](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:37 dist-test-slave-68xk krb5kdc[25058](info): set up 2 sockets
Aug 09 02:25:37 dist-test-slave-68xk krb5kdc[25058](info): commencing operation
krb5kdc: starting...
W20260809 02:25:38.760167 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:25:38 dist-test-slave-68xk krb5kdc[25058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:25:38.893899 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:45791
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:34631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:45791
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:39.010526 25077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:39.010957 25077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:39.011058 25077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:39.016223 25077 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:39.016289 25077 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 02:25:39.016309 25077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:39.016348 25077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:39.016381 25077 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:39.016410 25077 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:39.021819 25077 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:34631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:45791
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:45791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:39.022962 25077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:39.024024 25077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:39.032611 25083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:39.032724 25077 server_base.cc:1034] running on GCE node
W20260809 02:25:39.032632 25084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:39.032634 25090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:39.033444 25077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:39.034632 25077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:39.035820 25077 hybrid_clock.cc:648] HybridClock initialized: now 1786242339035787 us; error 45 us; skew 500 ppm
Aug 09 02:25:39 dist-test-slave-68xk krb5kdc[25058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242339, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:39.038616 25077 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:25:39.039427 25077 webserver.cc:460] Webserver started at http://127.21.214.190:36021/ using document root <none> and password file <none>
I20260809 02:25:39.039986 25077 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:39.040046 25077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:39.040220 25077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:39.042199 25077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "699496ff98e04195bb7b79ee13e06493"
format_stamp: "Formatted at 2026-08-09 02:25:39 on dist-test-slave-68xk"
server_key: "7d04196a48c413914aa015be8b1cb164"
server_key_iv: "be21837ac2b05a6ca4ca63dab2ef03d3"
server_key_version: "encryptionkey@0"
I20260809 02:25:39.042793 25077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "699496ff98e04195bb7b79ee13e06493"
format_stamp: "Formatted at 2026-08-09 02:25:39 on dist-test-slave-68xk"
server_key: "7d04196a48c413914aa015be8b1cb164"
server_key_iv: "be21837ac2b05a6ca4ca63dab2ef03d3"
server_key_version: "encryptionkey@0"
I20260809 02:25:39.046593 25077 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:25:39.048949 25102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:39.050192 25077 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:39.050354 25077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "699496ff98e04195bb7b79ee13e06493"
format_stamp: "Formatted at 2026-08-09 02:25:39 on dist-test-slave-68xk"
server_key: "7d04196a48c413914aa015be8b1cb164"
server_key_iv: "be21837ac2b05a6ca4ca63dab2ef03d3"
server_key_version: "encryptionkey@0"
I20260809 02:25:39.050513 25077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:39.066814 25077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:39.069581 25077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:39.069790 25077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:39.077823 25077 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:45791
I20260809 02:25:39.077852 25190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:45791 every 8 connection(s)
I20260809 02:25:39.078781 25077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:39.080796 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 25077
I20260809 02:25:39.080883 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:39.081164 22362 external_mini_cluster.cc:1428] Setting key 572e334062ee39bb608a3f94a1369b4e
I20260809 02:25:39.081601 25193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:39.088845 25193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493: Bootstrap starting.
Aug 09 02:25:39 dist-test-slave-68xk krb5kdc[25058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:39.091442 25193 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:39.092857 25193 log.cc:824] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:39.095162 25193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493: No bootstrap required, opened a new log
I20260809 02:25:39.096499 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.082618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57864 (local address 127.21.214.190:45791)
0809 02:25:39.083128 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:39.083148 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:39.083188 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:25:39.083960 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:39.083984 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:39.084388 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:39.084769 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:39.085404 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.086923 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.087778 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.088450 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.088609 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.091448 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:39.091457 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:39.091476 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:39.091509 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:39.093478 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.093952 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.093958 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.093963 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.094097 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.094370 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.094373 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.094375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.094891 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:39.095092 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:39.095296 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 02:25:39.095591 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":158,"threads_started":1}
I20260809 02:25:39.098850 25193 raft_consensus.cc:348] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699496ff98e04195bb7b79ee13e06493" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45791 } }
I20260809 02:25:39.099056 25193 raft_consensus.cc:374] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:39.099089 25193 raft_consensus.cc:729] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 699496ff98e04195bb7b79ee13e06493, State: Initialized, Role: FOLLOWER
I20260809 02:25:39.099483 25193 consensus_queue.cc:260] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699496ff98e04195bb7b79ee13e06493" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45791 } }
I20260809 02:25:39.099598 25193 raft_consensus.cc:388] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:39.099643 25193 raft_consensus.cc:482] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:39.099711 25193 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:39.100509 25193 raft_consensus.cc:504] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699496ff98e04195bb7b79ee13e06493" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45791 } }
I20260809 02:25:39.100787 25193 leader_election.cc:302] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 699496ff98e04195bb7b79ee13e06493; no voters:
I20260809 02:25:39.101078 25193 leader_election.cc:288] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:39.101199 25203 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:39.101480 25203 raft_consensus.cc:686] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [term 1 LEADER]: Becoming Leader. State: Replica: 699496ff98e04195bb7b79ee13e06493, State: Running, Role: LEADER
I20260809 02:25:39.101855 25203 consensus_queue.cc:237] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699496ff98e04195bb7b79ee13e06493" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45791 } }
I20260809 02:25:39.102305 25193 sys_catalog.cc:564] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:39.103546 25204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "699496ff98e04195bb7b79ee13e06493" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699496ff98e04195bb7b79ee13e06493" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45791 } } }
I20260809 02:25:39.103685 25204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:39.104069 25214 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:39.104056 25205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 699496ff98e04195bb7b79ee13e06493. Latest consensus state: current_term: 1 leader_uuid: "699496ff98e04195bb7b79ee13e06493" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699496ff98e04195bb7b79ee13e06493" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45791 } } }
I20260809 02:25:39.104745 25205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:39.107463 25214 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:39.112766 25214 catalog_manager.cc:1347] Generated new cluster ID: c6b88afa764d4a329cfb806f7e1f5611
I20260809 02:25:39.112829 25214 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:39.123309 25214 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:39.124414 25214 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:39.141201 25214 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493: Generated new TSK 0
I20260809 02:25:39.142045 25214 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:25:39.177474 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45791
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:34631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:39.293846 25236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:39.294109 25236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:39.294159 25236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:39.298147 25236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:39.298214 25236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:39.298255 25236 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 02:25:39.298270 25236 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:25:39.298305 25236 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:25:39.303821 25236 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:34631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.214.190:45791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:39.304849 25236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:39.305853 25236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:39.315481 25244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:39.315572 25243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:39.315481 25247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:39.315649 25236 server_base.cc:1034] running on GCE node
I20260809 02:25:39.316148 25236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:39.316784 25236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:39.317947 25236 hybrid_clock.cc:648] HybridClock initialized: now 1786242339317930 us; error 30 us; skew 500 ppm
Aug 09 02:25:39 dist-test-slave-68xk krb5kdc[25058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242339, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:39.320824 25236 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:25:39.321800 25236 webserver.cc:460] Webserver started at http://127.21.214.129:38487/ using document root <none> and password file <none>
I20260809 02:25:39.322399 25236 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:39.322553 25236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:39.322811 25236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:39.324875 25236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "6b2afce15c7747b1a31987d9c5bf9894"
format_stamp: "Formatted at 2026-08-09 02:25:39 on dist-test-slave-68xk"
server_key: "5dc02a3f85af12552eb11c43f91142ce"
server_key_iv: "b31d6368be46d67eede01014292eb938"
server_key_version: "encryptionkey@0"
I20260809 02:25:39.325471 25236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "6b2afce15c7747b1a31987d9c5bf9894"
format_stamp: "Formatted at 2026-08-09 02:25:39 on dist-test-slave-68xk"
server_key: "5dc02a3f85af12552eb11c43f91142ce"
server_key_iv: "b31d6368be46d67eede01014292eb938"
server_key_version: "encryptionkey@0"
I20260809 02:25:39.329311 25236 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260809 02:25:39.331817 25257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:39.333091 25236 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:25:39.333264 25236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "6b2afce15c7747b1a31987d9c5bf9894"
format_stamp: "Formatted at 2026-08-09 02:25:39 on dist-test-slave-68xk"
server_key: "5dc02a3f85af12552eb11c43f91142ce"
server_key_iv: "b31d6368be46d67eede01014292eb938"
server_key_version: "encryptionkey@0"
I20260809 02:25:39.333369 25236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:39.346393 25236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:39.349176 25236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:39.349385 25236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:39.350972 25236 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:39.351047 25236 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:39.351120 25236 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:39.351173 25236 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:25:39 dist-test-slave-68xk krb5kdc[25058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242339, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:39.362640 25236 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:42957
I20260809 02:25:39.363381 25439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:42957 every 8 connection(s)
I20260809 02:25:39.363595 25236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:25:39.364217 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 25236
I20260809 02:25:39.364352 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:25:39.364670 22362 external_mini_cluster.cc:1428] Setting key 77ea0015af85387f049b3669d33b68e4
I20260809 02:25:39.365464 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.351772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:34641 (local address 127.21.214.190:45791)
0809 02:25:39.351904 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:39.351907 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:39.353549 (+ 1642us) server_negotiation.cc:407] Connection header received
0809 02:25:39.354931 (+ 1382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:39.354935 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:39.354996 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:39.355087 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:39.356747 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.357385 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.358682 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.358935 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.359052 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.361542 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:39.361546 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:39.361549 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:39.361584 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:39.363164 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.363764 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.363768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.363769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.363864 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.364310 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.364314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.364315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.364538 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:39.364633 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:39.365158 (+ 525us) server_negotiation.cc:299] Negotiation successful
0809 02:25:39.365291 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:25:39.366328 25276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.352852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45791 (local address 127.21.214.129:34641)
0809 02:25:39.353366 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:39.353418 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:39.354711 (+ 1293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:39.355272 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:39.355284 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:39.355833 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:39.356561 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.356584 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.357521 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.357525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.358558 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.358568 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.359105 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.359109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.359282 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.359869 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:39.359885 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:39.361376 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:39.363293 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:39.363299 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:39.363315 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:39.363649 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:39.363990 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:39.363995 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:39.363997 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:39.364170 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:39.364690 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:39.364694 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:39.364903 (+ 209us) client_negotiation.cc:769] Sending connection context
0809 02:25:39.365101 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 02:25:39.365410 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":139,"threads_started":1}
I20260809 02:25:39.369284 25441 heartbeater.cc:347] Connected to a master server at 127.21.214.190:45791
I20260809 02:25:39.369441 25441 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:39.370007 25441 heartbeater.cc:511] Master 127.21.214.190:45791 requested a full tablet report, sending...
I20260809 02:25:39.371795 25121 ts_manager.cc:194] Registered new tserver with Master: 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957)
I20260809 02:25:39.372954 25121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:34641
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
I20260809 02:25:39.380885 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.373507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:41681 (local address 127.21.214.190:45791)
0809 02:25:39.373639 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:39.373647 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:39.373662 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:25:39.373698 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:39.373701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:39.373743 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:39.373827 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:39.374449 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.375164 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.376218 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.376431 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.376513 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.377658 (+ 1145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:39.377663 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:39.377666 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:39.377691 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:39.379244 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.379685 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.379693 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.379694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.379771 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.380068 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.380071 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.380073 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.380244 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:39.380350 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:39.380627 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 02:25:39.380752 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:25:39.380895 25454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.371505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45791 (local address 127.21.214.129:41681)
0809 02:25:39.371800 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:39.371817 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:39.371912 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:39.373886 (+ 1974us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:39.373892 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:39.374131 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:39.374282 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.374294 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.375321 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.375325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.376109 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.376119 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.376592 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.376595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.376668 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.377205 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:39.377219 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:39.377517 (+ 298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:39.379362 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:39.379366 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:39.379368 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:39.379572 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:39.379866 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:39.379870 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:39.379872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:39.379957 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:39.380354 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:39.380358 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:39.380453 (+ 95us) client_negotiation.cc:769] Sending connection context
0809 02:25:39.380557 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 02:25:39.380701 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":99,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:25:39.394834 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45791
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:34631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:39.508129 25456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:39.508380 25456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:39.508427 25456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:39.512364 25456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:39.512418 25456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:39.512457 25456 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 02:25:39.512471 25456 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:25:39.512501 25456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:25:39.517506 25456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:34631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.214.190:45791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:39.518446 25456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:39.519402 25456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:39.528784 25467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:39.528837 25463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:39.528879 25461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:39.529139 25456 server_base.cc:1034] running on GCE node
I20260809 02:25:39.529529 25456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:39.530131 25456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:39.531328 25456 hybrid_clock.cc:648] HybridClock initialized: now 1786242339531296 us; error 52 us; skew 500 ppm
Aug 09 02:25:39 dist-test-slave-68xk krb5kdc[25058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242339, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:39.533999 25456 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:25:39.534962 25456 webserver.cc:460] Webserver started at http://127.21.214.130:34445/ using document root <none> and password file <none>
I20260809 02:25:39.535622 25456 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:39.535710 25456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:39.535910 25456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:39.537904 25456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "fd82af5125954598a155769b2fb2bed0"
format_stamp: "Formatted at 2026-08-09 02:25:39 on dist-test-slave-68xk"
server_key: "bb8609843e4000a203ef396433fb6f20"
server_key_iv: "06a055561112634fe1c4767de2486c18"
server_key_version: "encryptionkey@0"
I20260809 02:25:39.538475 25456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "fd82af5125954598a155769b2fb2bed0"
format_stamp: "Formatted at 2026-08-09 02:25:39 on dist-test-slave-68xk"
server_key: "bb8609843e4000a203ef396433fb6f20"
server_key_iv: "06a055561112634fe1c4767de2486c18"
server_key_version: "encryptionkey@0"
I20260809 02:25:39.542228 25456 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260809 02:25:39.544605 25478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:39.545854 25456 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:39.545987 25456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "fd82af5125954598a155769b2fb2bed0"
format_stamp: "Formatted at 2026-08-09 02:25:39 on dist-test-slave-68xk"
server_key: "bb8609843e4000a203ef396433fb6f20"
server_key_iv: "06a055561112634fe1c4767de2486c18"
server_key_version: "encryptionkey@0"
I20260809 02:25:39.546097 25456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:39.562999 25456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:39.565829 25456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:39.566032 25456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:39.567569 25456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:39.567641 25456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:39.567714 25456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:39.567775 25456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:25:39 dist-test-slave-68xk krb5kdc[25058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242339, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:39.579399 25456 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:39637
I20260809 02:25:39.579406 25644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:39637 every 8 connection(s)
I20260809 02:25:39.580484 25456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:25:39.582017 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.568328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:45025 (local address 127.21.214.190:45791)
0809 02:25:39.568464 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:39.568468 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:39.570232 (+ 1764us) server_negotiation.cc:407] Connection header received
0809 02:25:39.571455 (+ 1223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:39.571458 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:39.571520 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:39.571631 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:39.572879 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.573410 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.574700 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.575065 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.575196 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.577924 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:39.577928 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:39.577931 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:39.577962 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:39.579694 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.580262 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.580265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.580267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.580365 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.580780 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.580784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.580789 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.581047 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:39.581158 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:39.581790 (+ 632us) server_negotiation.cc:299] Negotiation successful
0809 02:25:39.581898 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:25:39.582679 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 25456
I20260809 02:25:39.582809 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:25:39.582973 25495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.569357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45791 (local address 127.21.214.130:45025)
0809 02:25:39.570064 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:39.570123 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:39.571243 (+ 1120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:39.571821 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:39.571846 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:39.572278 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:39.572720 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.572734 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.573542 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.573545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.574579 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.574593 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.575253 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.575261 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.575504 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.576221 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:39.576240 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:39.577753 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:39.579845 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:39.579849 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:39.579860 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:39.580145 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:39.580482 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:39.580485 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:39.580486 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:39.580666 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:39.581237 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:39.581243 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:39.581524 (+ 281us) client_negotiation.cc:769] Sending connection context
0809 02:25:39.581722 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 02:25:39.581967 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":137,"threads_started":1}
I20260809 02:25:39.583134 22362 external_mini_cluster.cc:1428] Setting key 91ac23ae146a2a8829c5134e19d1450a
I20260809 02:25:39.584278 25645 heartbeater.cc:347] Connected to a master server at 127.21.214.190:45791
I20260809 02:25:39.584501 25645 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:39.585088 25645 heartbeater.cc:511] Master 127.21.214.190:45791 requested a full tablet report, sending...
I20260809 02:25:39.586249 25121 ts_manager.cc:194] Registered new tserver with Master: fd82af5125954598a155769b2fb2bed0 (127.21.214.130:39637)
I20260809 02:25:39.587046 25121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:45025
I20260809 02:25:39.594735 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.586797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:55711 (local address 127.21.214.190:45791)
0809 02:25:39.586922 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:39.586929 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:39.586946 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:25:39.586988 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:39.586993 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:39.587043 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:39.587133 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:39.587651 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.588391 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.589693 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.589913 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.589996 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.591466 (+ 1470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:39.591469 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:39.591471 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:39.591493 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:39.592924 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.593410 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.593413 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.593414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.593485 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.593820 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.593825 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.593829 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.594061 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:39.594144 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:39.594512 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 02:25:39.594613 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:25:39.594981 25659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.586437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45791 (local address 127.21.214.130:55711)
0809 02:25:39.586686 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:39.586702 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:39.586791 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:39.587178 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:39.587181 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:39.587425 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:39.587523 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.587529 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.588542 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.588548 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.589561 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.589576 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.590047 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.590051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.590182 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.590824 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:39.590845 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:39.591322 (+ 477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:39.593044 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:39.593047 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:39.593049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:39.593308 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:39.593584 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:39.593589 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:39.593594 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:39.593700 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:39.594176 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:39.594179 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:39.594280 (+ 101us) client_negotiation.cc:769] Sending connection context
0809 02:25:39.594431 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 02:25:39.594599 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":93,"threads_started":1}
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:25:39.615540 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45791
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:34631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:39.729705 25665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:39.729952 25665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:39.730034 25665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:39.734015 25665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:39.734073 25665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:39.734148 25665 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 02:25:39.734180 25665 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:25:39.734237 25665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:25:39.739580 25665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:34631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.214.190:45791
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:39.740600 25665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:39.741636 25665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:39.751325 25677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:39.751466 25665 server_base.cc:1034] running on GCE node
W20260809 02:25:39.751325 25673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:39.751322 25675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:39.752020 25665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:39.752678 25665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:39.753878 25665 hybrid_clock.cc:648] HybridClock initialized: now 1786242339753860 us; error 31 us; skew 500 ppm
Aug 09 02:25:39 dist-test-slave-68xk krb5kdc[25058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242339, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:39.756889 25665 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:25:39.757754 25665 webserver.cc:460] Webserver started at http://127.21.214.131:45173/ using document root <none> and password file <none>
I20260809 02:25:39.758340 25665 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:39.758457 25665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:39.758730 25665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:39.760787 25665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "b3cbf0e587464ab29cbf2002a0ed2258"
format_stamp: "Formatted at 2026-08-09 02:25:39 on dist-test-slave-68xk"
server_key: "03dab9e9cd3807040459ad5d61661f07"
server_key_iv: "8d5c18f06d3a6abdc5b3485d5af20946"
server_key_version: "encryptionkey@0"
I20260809 02:25:39.761370 25665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "b3cbf0e587464ab29cbf2002a0ed2258"
format_stamp: "Formatted at 2026-08-09 02:25:39 on dist-test-slave-68xk"
server_key: "03dab9e9cd3807040459ad5d61661f07"
server_key_iv: "8d5c18f06d3a6abdc5b3485d5af20946"
server_key_version: "encryptionkey@0"
I20260809 02:25:39.765185 25665 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260809 02:25:39.767660 25687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:39.768903 25665 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:25:39.769040 25665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "b3cbf0e587464ab29cbf2002a0ed2258"
format_stamp: "Formatted at 2026-08-09 02:25:39 on dist-test-slave-68xk"
server_key: "03dab9e9cd3807040459ad5d61661f07"
server_key_iv: "8d5c18f06d3a6abdc5b3485d5af20946"
server_key_version: "encryptionkey@0"
I20260809 02:25:39.769153 25665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:39.782713 25665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:39.785831 25665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:39.786031 25665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:39.787547 25665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:39.787622 25665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:39.787693 25665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:39.787745 25665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:25:39 dist-test-slave-68xk krb5kdc[25058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242339, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:39.798709 25665 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:34305
I20260809 02:25:39.798854 25851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:34305 every 8 connection(s)
I20260809 02:25:39.799635 25665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:25:39.802136 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.788448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:33283 (local address 127.21.214.190:45791)
0809 02:25:39.788632 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:39.788640 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:39.789420 (+ 780us) server_negotiation.cc:407] Connection header received
0809 02:25:39.790597 (+ 1177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:39.790601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:39.790663 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:39.790730 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:39.792467 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.793360 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.795143 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.795536 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.795657 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.798247 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:39.798254 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:39.798259 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:39.798296 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:39.799973 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.800602 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.800606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.800607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.800695 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.801058 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.801061 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.801063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.801258 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:39.801370 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:39.801849 (+ 479us) server_negotiation.cc:299] Negotiation successful
0809 02:25:39.801974 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 02:25:39.802388 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 25665
I20260809 02:25:39.802522 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:25:39.802896 22362 external_mini_cluster.cc:1428] Setting key 29f093c3e7122d2e2e7387774b4c352d
I20260809 02:25:39.803233 25697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.788801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45791 (local address 127.21.214.131:33283)
0809 02:25:39.789255 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:39.789305 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:39.790318 (+ 1013us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:39.791167 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:39.791175 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:39.791677 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:39.792288 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.792308 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.793511 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.793515 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.794996 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.795008 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.795696 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.795699 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.795876 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.796556 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:39.796576 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:39.798054 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:39.800093 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:39.800099 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:39.800114 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:39.800481 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:39.800800 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:39.800803 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:39.800805 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:39.800956 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:39.801369 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:39.801376 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:39.801612 (+ 236us) client_negotiation.cc:769] Sending connection context
0809 02:25:39.801806 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 02:25:39.802136 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":132,"threads_started":1}
I20260809 02:25:39.804978 25852 heartbeater.cc:347] Connected to a master server at 127.21.214.190:45791
I20260809 02:25:39.805151 25852 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:39.805732 25852 heartbeater.cc:511] Master 127.21.214.190:45791 requested a full tablet report, sending...
I20260809 02:25:39.806818 25121 ts_manager.cc:194] Registered new tserver with Master: b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305)
I20260809 02:25:39.807608 25121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:33283
I20260809 02:25:39.813438 25862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.806728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45791 (local address 127.21.214.131:50299)
0809 02:25:39.807091 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:39.807106 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:39.807204 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:39.807435 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:39.807438 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:39.807654 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:39.807777 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.807784 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.808841 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.808843 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.809402 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.809410 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.809866 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.809869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.809936 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.810388 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:39.810399 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:39.810773 (+ 374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:39.812208 (+ 1435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:39.812211 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:39.812212 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:39.812411 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:39.812648 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:39.812650 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:39.812651 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:39.812723 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:39.813035 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:39.813037 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:39.813107 (+ 70us) client_negotiation.cc:769] Sending connection context
0809 02:25:39.813184 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:25:39.813300 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":1,"thread_start_us":119,"threads_started":1}
I20260809 02:25:39.813457 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.806787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:50299 (local address 127.21.214.190:45791)
0809 02:25:39.806924 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:39.806928 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:39.807182 (+ 254us) server_negotiation.cc:407] Connection header received
0809 02:25:39.807293 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:39.807295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:39.807331 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:39.807397 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:39.807980 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.808709 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.809520 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.809762 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.809847 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.810897 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:39.810899 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:39.810902 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:39.810923 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:39.812112 (+ 1189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.812496 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.812498 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.812499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.812570 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.812801 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.812804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.812805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.812954 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:39.813030 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:39.813247 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 02:25:39.813351 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:25:39.816830 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:25:39 dist-test-slave-68xk krb5kdc[25058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:25:39 dist-test-slave-68xk krb5kdc[25058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:39.844822 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.836260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57878 (local address 127.21.214.190:45791)
0809 02:25:39.836430 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:39.836434 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:39.836449 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:25:39.836491 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:39.836493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:39.836533 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:39.836620 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:39.837384 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.837916 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.838897 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.839121 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.839213 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.841811 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:39.841814 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:39.841817 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:39.841841 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:39.843406 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.843787 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.843789 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.843790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.843863 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:39.844099 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:39.844101 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:39.844102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:39.844294 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:39.844398 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:39.844599 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 02:25:39.844698 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 02:25:39.847896 25121 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:25:39.851089 25121 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:25:39.866011 25887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.860104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34554 (local address 127.21.214.129:42957)
0809 02:25:39.860496 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:39.860513 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:39.861120 (+ 607us) server_negotiation.cc:407] Connection header received
0809 02:25:39.861188 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:39.861192 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:39.861335 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:39.861495 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:39.861785 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.863080 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.864730 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.865370 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.865529 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.865657 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:39.865762 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 02:25:39.865854 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":85,"threads_started":1}
I20260809 02:25:39.865998 25885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.859685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:42957 (local address 127.0.0.1:34554)
0809 02:25:39.860721 (+ 1036us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:39.860777 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:39.861019 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:39.861493 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:39.861499 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:39.861522 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:39.861654 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.861660 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.863214 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.863217 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.864555 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.864567 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.865509 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.865515 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.865602 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.865624 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:25:39.865734 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 02:25:39.865850 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"mutex_wait_us":45,"thread_start_us":85,"threads_started":1}
I20260809 02:25:39.866093 25886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.860018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57084 (local address 127.21.214.130:39637)
0809 02:25:39.860937 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:39.860952 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:39.861005 (+ 53us) server_negotiation.cc:407] Connection header received
0809 02:25:39.861089 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:39.861096 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:39.861328 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:39.861496 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:39.861909 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.862821 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.864325 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.865068 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.865204 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.865349 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:39.865822 (+ 473us) server_negotiation.cc:299] Negotiation successful
0809 02:25:39.865920 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":102,"threads_started":1}
I20260809 02:25:39.866590 25890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.860804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42006 (local address 127.21.214.131:34305)
0809 02:25:39.861223 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:39.861234 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:39.861554 (+ 320us) server_negotiation.cc:407] Connection header received
0809 02:25:39.861637 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:39.861641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:39.861829 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:39.861979 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:39.862203 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.863280 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.864691 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.865487 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.865623 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.865766 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:39.866297 (+ 531us) server_negotiation.cc:299] Negotiation successful
0809 02:25:39.866399 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":113,"threads_started":1}
I20260809 02:25:39.866971 25884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.860451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:34305 (local address 127.0.0.1:42006)
0809 02:25:39.861356 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:39.861370 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:39.861463 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:39.861973 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:39.861977 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:39.861995 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:39.862084 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.862090 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.863402 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.863405 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.864560 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.864567 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.865831 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.865835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.865918 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.865938 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:25:39.866008 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:25:39.866069 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":839,"mutex_wait_us":5,"thread_start_us":102,"threads_started":1}
I20260809 02:25:39.867106 25889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:39.859782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:39637 (local address 127.0.0.1:57084)
0809 02:25:39.860733 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:39.860776 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:39.860906 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:39.861651 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:39.861653 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:39.861668 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:39.861791 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.861796 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.862934 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.862940 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.864194 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:39.864204 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:39.865420 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:39.865423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:39.865551 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:39.865603 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 02:25:39.865707 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 02:25:39.866942 (+ 1235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":909,"mutex_wait_us":1168,"thread_start_us":114,"threads_started":1}
I20260809 02:25:39.869694 25550 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6c1ba789ed452db301b776d43926ee (DEFAULT_TABLE table=test-table [id=995673c19c8c4027957bde0176905668]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:39.869666 25338 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6c1ba789ed452db301b776d43926ee (DEFAULT_TABLE table=test-table [id=995673c19c8c4027957bde0176905668]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:39.869679 25752 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6c1ba789ed452db301b776d43926ee (DEFAULT_TABLE table=test-table [id=995673c19c8c4027957bde0176905668]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:39.870755 25550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6c1ba789ed452db301b776d43926ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:39.870771 25338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6c1ba789ed452db301b776d43926ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:39.870788 25752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6c1ba789ed452db301b776d43926ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:39.877714 25891 tablet_bootstrap.cc:492] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0: Bootstrap starting.
I20260809 02:25:39.879146 25893 tablet_bootstrap.cc:492] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258: Bootstrap starting.
I20260809 02:25:39.880000 25891 tablet_bootstrap.cc:654] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:39.880748 25891 log.cc:824] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:39.881139 25893 tablet_bootstrap.cc:654] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:39.881812 25893 log.cc:824] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:39.882401 25892 tablet_bootstrap.cc:492] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894: Bootstrap starting.
I20260809 02:25:39.882790 25891 tablet_bootstrap.cc:492] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0: No bootstrap required, opened a new log
I20260809 02:25:39.882997 25891 ts_tablet_manager.cc:1397] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:25:39.883812 25893 tablet_bootstrap.cc:492] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258: No bootstrap required, opened a new log
I20260809 02:25:39.884008 25893 ts_tablet_manager.cc:1397] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 02:25:39.884708 25892 tablet_bootstrap.cc:654] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:39.885908 25892 log.cc:824] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:39.886919 25891 raft_consensus.cc:348] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:39.887161 25891 raft_consensus.cc:374] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:39.887213 25891 raft_consensus.cc:729] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd82af5125954598a155769b2fb2bed0, State: Initialized, Role: FOLLOWER
I20260809 02:25:39.887669 25891 consensus_queue.cc:260] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:39.887887 25892 tablet_bootstrap.cc:492] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894: No bootstrap required, opened a new log
I20260809 02:25:39.888077 25892 ts_tablet_manager.cc:1397] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:25:39.888075 25893 raft_consensus.cc:348] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:39.888345 25893 raft_consensus.cc:374] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:39.888407 25893 raft_consensus.cc:729] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbf0e587464ab29cbf2002a0ed2258, State: Initialized, Role: FOLLOWER
I20260809 02:25:39.888700 25891 ts_tablet_manager.cc:1428] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:25:39.888816 25893 consensus_queue.cc:260] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:39.889101 25645 heartbeater.cc:503] Master 127.21.214.190:45791 was elected leader, sending a full tablet report...
I20260809 02:25:39.889525 25852 heartbeater.cc:503] Master 127.21.214.190:45791 was elected leader, sending a full tablet report...
I20260809 02:25:39.889806 25893 ts_tablet_manager.cc:1428] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 02:25:39.892037 25892 raft_consensus.cc:348] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:39.892305 25892 raft_consensus.cc:374] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:39.892367 25892 raft_consensus.cc:729] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b2afce15c7747b1a31987d9c5bf9894, State: Initialized, Role: FOLLOWER
I20260809 02:25:39.892803 25892 consensus_queue.cc:260] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:39.893556 25441 heartbeater.cc:503] Master 127.21.214.190:45791 was elected leader, sending a full tablet report...
I20260809 02:25:39.893772 25892 ts_tablet_manager.cc:1428] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260809 02:25:40.050972 25853 tablet.cc:2369] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:25:40.081761 25646 tablet.cc:2369] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:25:40.082265 25897 raft_consensus.cc:482] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:25:40.082474 25897 raft_consensus.cc:504] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.083829 25897 leader_election.cc:288] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957), b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305)
I20260809 02:25:40.088363 25900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.084025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:42957 (local address 127.21.214.130:54917)
0809 02:25:40.084527 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:40.084541 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:40.084676 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:40.084942 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:40.084945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:40.084962 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:40.085128 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.085134 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.086249 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.086252 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.087182 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.087192 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.087923 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.087926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.088036 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.088062 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:25:40.088139 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:25:40.088202 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":80,"thread_start_us":110,"threads_started":1}
I20260809 02:25:40.088413 25887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.084353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:54917 (local address 127.21.214.129:42957)
0809 02:25:40.084481 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:40.084487 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:40.084663 (+ 176us) server_negotiation.cc:407] Connection header received
0809 02:25:40.084790 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:40.084793 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:40.084844 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:40.084930 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:40.085309 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.086097 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.087312 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.087797 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.087919 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.087972 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:40.088169 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 02:25:40.088257 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:25:40.089026 25370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6c1ba789ed452db301b776d43926ee" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2afce15c7747b1a31987d9c5bf9894" is_pre_election: true
I20260809 02:25:40.089236 25890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.084377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:33011 (local address 127.21.214.131:34305)
0809 02:25:40.084490 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:40.084495 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:40.084627 (+ 132us) server_negotiation.cc:407] Connection header received
0809 02:25:40.084794 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:40.084797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:40.084845 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:40.084891 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:40.085269 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.086097 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.087671 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.088281 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.088394 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.088453 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:40.089029 (+ 576us) server_negotiation.cc:299] Negotiation successful
0809 02:25:40.089107 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:25:40.089326 25370 raft_consensus.cc:2454] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 0.
I20260809 02:25:40.089506 25901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.084066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:34305 (local address 127.21.214.130:33011)
0809 02:25:40.084516 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:40.084531 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:40.084654 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:40.085025 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:40.085027 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:40.085058 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:40.085163 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.085169 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.086219 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.086223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.087527 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.087538 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.088814 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.088817 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.088898 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.088916 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 02:25:40.089010 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 02:25:40.089076 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":66,"thread_start_us":94,"threads_started":1}
I20260809 02:25:40.090022 25481 leader_election.cc:302] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b2afce15c7747b1a31987d9c5bf9894, fd82af5125954598a155769b2fb2bed0; no voters:
I20260809 02:25:40.090157 25781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6c1ba789ed452db301b776d43926ee" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" is_pre_election: true
I20260809 02:25:40.090286 25897 raft_consensus.cc:2781] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:25:40.090368 25897 raft_consensus.cc:482] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:25:40.090445 25897 raft_consensus.cc:3037] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:40.090480 25781 raft_consensus.cc:2454] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 0.
I20260809 02:25:40.092056 25897 raft_consensus.cc:504] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.092432 25897 leader_election.cc:288] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 election: Requested vote from peers 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957), b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305)
I20260809 02:25:40.092728 25370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6c1ba789ed452db301b776d43926ee" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2afce15c7747b1a31987d9c5bf9894"
I20260809 02:25:40.092799 25781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6c1ba789ed452db301b776d43926ee" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbf0e587464ab29cbf2002a0ed2258"
I20260809 02:25:40.092866 25370 raft_consensus.cc:3037] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:40.092931 25781 raft_consensus.cc:3037] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:40.093946 25370 raft_consensus.cc:2454] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 1.
I20260809 02:25:40.094285 25481 leader_election.cc:302] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b2afce15c7747b1a31987d9c5bf9894, fd82af5125954598a155769b2fb2bed0; no voters:
I20260809 02:25:40.094358 25781 raft_consensus.cc:2454] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 1.
I20260809 02:25:40.094532 25897 raft_consensus.cc:2781] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:40.094743 25897 raft_consensus.cc:686] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [term 1 LEADER]: Becoming Leader. State: Replica: fd82af5125954598a155769b2fb2bed0, State: Running, Role: LEADER
I20260809 02:25:40.095058 25897 consensus_queue.cc:237] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.098286 25123 catalog_manager.cc:5495] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd82af5125954598a155769b2fb2bed0 (127.21.214.130). New cstate: current_term: 1 leader_uuid: "fd82af5125954598a155769b2fb2bed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } health_report { overall_health: UNKNOWN } } }
W20260809 02:25:40.115392 25443 tablet.cc:2369] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 02:25:40 dist-test-slave-68xk krb5kdc[25058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242339, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:40.185105 25913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.176166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45791 (local address 127.0.0.1:57888)
0809 02:25:40.176493 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:40.176506 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:40.176612 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:40.176844 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:40.176846 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:40.177239 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:40.177361 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.177367 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.178236 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.178238 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.178827 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.178835 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.179336 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.179338 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.179402 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.179945 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:40.179956 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:40.181459 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:40.183384 (+ 1925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:40.183392 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:40.183399 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:40.183621 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:40.183965 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:40.183968 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:40.183969 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:40.184043 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:40.184574 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:40.184580 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:40.184689 (+ 109us) client_negotiation.cc:769] Sending connection context
0809 02:25:40.184811 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 02:25:40.184938 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":142,"threads_started":1}
I20260809 02:25:40.185194 25200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.176247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57888 (local address 127.21.214.190:45791)
0809 02:25:40.176395 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:40.176401 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:40.176588 (+ 187us) server_negotiation.cc:407] Connection header received
0809 02:25:40.176691 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:40.176693 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:40.176735 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:40.176807 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:40.177503 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.178129 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.178940 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.179209 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.179301 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.181640 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:40.181643 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:40.181645 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:40.181666 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:40.183284 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:40.183747 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:40.183750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:40.183752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:40.183862 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:40.184166 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:40.184172 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:40.184174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:40.184465 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:40.184547 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:40.184897 (+ 350us) server_negotiation.cc:299] Negotiation successful
0809 02:25:40.185055 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 02:25:40.189024 25123 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:57888:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 02:25:40.189733 25123 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:25:40.195279 25338 tablet_service.cc:1467] Processing CreateTablet for tablet 949cf7aae2e2456ea76839327145aaae (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fa67629c564e47d8ba2b6108a3f54b47]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:25:40.195540 25752 tablet_service.cc:1467] Processing CreateTablet for tablet 949cf7aae2e2456ea76839327145aaae (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fa67629c564e47d8ba2b6108a3f54b47]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:25:40.196105 25338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 949cf7aae2e2456ea76839327145aaae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:40.196254 25752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 949cf7aae2e2456ea76839327145aaae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:40.197283 25550 tablet_service.cc:1467] Processing CreateTablet for tablet 949cf7aae2e2456ea76839327145aaae (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fa67629c564e47d8ba2b6108a3f54b47]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:25:40.198244 25550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 949cf7aae2e2456ea76839327145aaae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:40.199445 25892 tablet_bootstrap.cc:492] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894: Bootstrap starting.
I20260809 02:25:40.199766 25893 tablet_bootstrap.cc:492] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258: Bootstrap starting.
I20260809 02:25:40.200564 25892 tablet_bootstrap.cc:654] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:40.200820 25893 tablet_bootstrap.cc:654] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:40.201021 25891 tablet_bootstrap.cc:492] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0: Bootstrap starting.
I20260809 02:25:40.202023 25891 tablet_bootstrap.cc:654] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:40.202234 25892 tablet_bootstrap.cc:492] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894: No bootstrap required, opened a new log
I20260809 02:25:40.202226 25893 tablet_bootstrap.cc:492] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258: No bootstrap required, opened a new log
I20260809 02:25:40.202319 25893 ts_tablet_manager.cc:1397] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:25:40.202319 25892 ts_tablet_manager.cc:1397] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:25:40.202867 25892 raft_consensus.cc:348] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.202862 25893 raft_consensus.cc:348] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.202982 25893 raft_consensus.cc:374] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:40.202982 25892 raft_consensus.cc:374] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:40.203023 25892 raft_consensus.cc:729] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b2afce15c7747b1a31987d9c5bf9894, State: Initialized, Role: FOLLOWER
I20260809 02:25:40.203023 25893 raft_consensus.cc:729] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbf0e587464ab29cbf2002a0ed2258, State: Initialized, Role: FOLLOWER
I20260809 02:25:40.203157 25892 consensus_queue.cc:260] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.203158 25893 consensus_queue.cc:260] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.203434 25892 ts_tablet_manager.cc:1428] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:25:40.203480 25898 tablet_replica.cc:439] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } } }
I20260809 02:25:40.203583 25891 tablet_bootstrap.cc:492] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0: No bootstrap required, opened a new log
I20260809 02:25:40.203620 25898 tablet_replica.cc:442] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:40.203647 25891 ts_tablet_manager.cc:1397] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260809 02:25:40.204032 25891 raft_consensus.cc:348] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.204172 25891 raft_consensus.cc:374] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:40.204227 25891 raft_consensus.cc:729] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd82af5125954598a155769b2fb2bed0, State: Initialized, Role: FOLLOWER
I20260809 02:25:40.204368 25891 consensus_queue.cc:260] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.204638 25893 ts_tablet_manager.cc:1428] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 02:25:40.204648 25899 tablet_replica.cc:439] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } } }
I20260809 02:25:40.204811 25899 tablet_replica.cc:442] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:40.205333 25891 ts_tablet_manager.cc:1428] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260809 02:25:40.205294 25897 tablet_replica.cc:439] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } } }
I20260809 02:25:40.205420 25897 tablet_replica.cc:442] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:40.363642 25899 raft_consensus.cc:482] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:25:40.363783 25899 raft_consensus.cc:504] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.364995 25899 leader_election.cc:288] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fd82af5125954598a155769b2fb2bed0 (127.21.214.130:39637), b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305)
I20260809 02:25:40.370271 25920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.365327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:34305 (local address 127.21.214.129:38017)
0809 02:25:40.365825 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:40.365840 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:40.365965 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:40.366334 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:40.366337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:40.366353 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:40.366616 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.366626 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.367796 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.367799 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.368908 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.368916 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.369791 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.369795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.369912 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.369936 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:25:40.370015 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 02:25:40.370101 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"mutex_wait_us":35,"thread_start_us":145,"threads_started":1}
I20260809 02:25:40.370273 25890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.365706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:38017 (local address 127.21.214.131:34305)
0809 02:25:40.365882 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:40.365888 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:40.365905 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:25:40.366089 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:40.366092 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:40.366141 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:40.366213 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:40.366923 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.367682 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.369085 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.369625 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.369782 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.369841 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:40.370063 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 02:25:40.370146 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:25:40.370404 25886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.365516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:56157 (local address 127.21.214.130:39637)
0809 02:25:40.365673 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:40.365678 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:40.366236 (+ 558us) server_negotiation.cc:407] Connection header received
0809 02:25:40.366301 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:40.366304 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:40.366349 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:40.366484 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:40.366850 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.367477 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.369052 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.369713 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.369826 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.369875 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:40.370182 (+ 307us) server_negotiation.cc:299] Negotiation successful
0809 02:25:40.370264 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:25:40.370782 25918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.365425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:39637 (local address 127.21.214.129:56157)
0809 02:25:40.365974 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:40.365990 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:40.366123 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:40.366478 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:40.366481 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:40.366497 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:40.366673 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.366681 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.367595 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.367599 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.368905 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.368916 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.369925 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.369928 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.370027 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.370046 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 02:25:40.370574 (+ 528us) client_negotiation.cc:240] Negotiation successful
0809 02:25:40.370649 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":38,"thread_start_us":93,"threads_started":1}
I20260809 02:25:40.370864 25897 raft_consensus.cc:482] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:25:40.370967 25897 raft_consensus.cc:504] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.371351 25897 leader_election.cc:288] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957), b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305)
I20260809 02:25:40.371650 25575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949cf7aae2e2456ea76839327145aaae" candidate_uuid: "6b2afce15c7747b1a31987d9c5bf9894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd82af5125954598a155769b2fb2bed0" is_pre_election: true
I20260809 02:25:40.371690 25370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949cf7aae2e2456ea76839327145aaae" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2afce15c7747b1a31987d9c5bf9894" is_pre_election: true
I20260809 02:25:40.371819 25370 raft_consensus.cc:2454] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 0.
I20260809 02:25:40.371822 25780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949cf7aae2e2456ea76839327145aaae" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" is_pre_election: true
I20260809 02:25:40.371878 25575 raft_consensus.cc:2454] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b2afce15c7747b1a31987d9c5bf9894 in term 0.
I20260809 02:25:40.371985 25780 raft_consensus.cc:2454] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 0.
I20260809 02:25:40.372103 25481 leader_election.cc:302] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b2afce15c7747b1a31987d9c5bf9894, fd82af5125954598a155769b2fb2bed0; no voters:
I20260809 02:25:40.372254 25781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949cf7aae2e2456ea76839327145aaae" candidate_uuid: "6b2afce15c7747b1a31987d9c5bf9894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" is_pre_election: true
I20260809 02:25:40.372390 25781 raft_consensus.cc:2454] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b2afce15c7747b1a31987d9c5bf9894 in term 0.
I20260809 02:25:40.372346 25260 leader_election.cc:302] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b2afce15c7747b1a31987d9c5bf9894, fd82af5125954598a155769b2fb2bed0; no voters:
I20260809 02:25:40.372660 25899 raft_consensus.cc:2781] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:25:40.372676 25897 raft_consensus.cc:2781] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:25:40.372732 25897 raft_consensus.cc:482] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:25:40.372735 25899 raft_consensus.cc:482] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:25:40.372767 25897 raft_consensus.cc:3037] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:40.372777 25899 raft_consensus.cc:3037] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:40.373984 25899 raft_consensus.cc:504] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.373971 25897 raft_consensus.cc:504] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.374338 25897 leader_election.cc:288] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 election: Requested vote from peers 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957), b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305)
I20260809 02:25:40.374372 25899 leader_election.cc:288] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [CANDIDATE]: Term 1 election: Requested vote from peers fd82af5125954598a155769b2fb2bed0 (127.21.214.130:39637), b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305)
I20260809 02:25:40.374680 25370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949cf7aae2e2456ea76839327145aaae" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2afce15c7747b1a31987d9c5bf9894"
I20260809 02:25:40.374869 25370 raft_consensus.cc:2379] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fd82af5125954598a155769b2fb2bed0 in current term 1: Already voted for candidate 6b2afce15c7747b1a31987d9c5bf9894 in this term.
I20260809 02:25:40.374931 25781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949cf7aae2e2456ea76839327145aaae" candidate_uuid: "6b2afce15c7747b1a31987d9c5bf9894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbf0e587464ab29cbf2002a0ed2258"
I20260809 02:25:40.374931 25780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949cf7aae2e2456ea76839327145aaae" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbf0e587464ab29cbf2002a0ed2258"
I20260809 02:25:40.375087 25781 raft_consensus.cc:3037] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:40.375308 25575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "949cf7aae2e2456ea76839327145aaae" candidate_uuid: "6b2afce15c7747b1a31987d9c5bf9894" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd82af5125954598a155769b2fb2bed0"
I20260809 02:25:40.375479 25575 raft_consensus.cc:2379] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b2afce15c7747b1a31987d9c5bf9894 in current term 1: Already voted for candidate fd82af5125954598a155769b2fb2bed0 in this term.
I20260809 02:25:40.375701 25479 leader_election.cc:302] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fd82af5125954598a155769b2fb2bed0; no voters: 6b2afce15c7747b1a31987d9c5bf9894, b3cbf0e587464ab29cbf2002a0ed2258
I20260809 02:25:40.375910 25897 raft_consensus.cc:2726] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260809 02:25:40.376364 25781 raft_consensus.cc:2454] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b2afce15c7747b1a31987d9c5bf9894 in term 1.
I20260809 02:25:40.376650 25258 leader_election.cc:302] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b2afce15c7747b1a31987d9c5bf9894, b3cbf0e587464ab29cbf2002a0ed2258; no voters: fd82af5125954598a155769b2fb2bed0
I20260809 02:25:40.376879 25899 raft_consensus.cc:2781] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:40.377096 25899 raft_consensus.cc:686] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 LEADER]: Becoming Leader. State: Replica: 6b2afce15c7747b1a31987d9c5bf9894, State: Running, Role: LEADER
I20260809 02:25:40.377453 25899 consensus_queue.cc:237] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.379686 25924 tablet_replica.cc:439] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894: TxnStatusTablet state changed. Reason: New leader 6b2afce15c7747b1a31987d9c5bf9894. Latest consensus state: current_term: 1 leader_uuid: "6b2afce15c7747b1a31987d9c5bf9894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } } }
I20260809 02:25:40.379808 25924 tablet_replica.cc:442] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:25:40.380110 25927 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 02:25:40.380336 25927 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 02:25:40.381096 25120 catalog_manager.cc:5495] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129). New cstate: current_term: 1 leader_uuid: "6b2afce15c7747b1a31987d9c5bf9894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } health_report { overall_health: UNKNOWN } } }
I20260809 02:25:40.399847 25913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.395406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:42957 (local address 127.0.0.1:34556)
0809 02:25:40.395618 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:40.395632 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:40.395722 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:40.396102 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:40.396104 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:40.396111 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:25:40.396210 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.396214 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.397342 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.397345 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.397958 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.397966 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.398645 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.398648 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.398722 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.398769 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:25:40.399559 (+ 790us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:25:40.399592 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 02:25:40.399653 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 02:25:40.399730 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 02:25:40.399935 25887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.395529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34556 (local address 127.21.214.129:42957)
0809 02:25:40.395689 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:40.395694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:40.395714 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:25:40.395881 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:40.395884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:40.395953 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:40.396080 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:40.396330 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.397213 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.398101 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.398523 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.398638 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.398917 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:40.399452 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:40.399578 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:40.399686 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 02:25:40.399749 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:25:40.405390 25575 raft_consensus.cc:1261] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Refusing update from remote peer 6b2afce15c7747b1a31987d9c5bf9894: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:40.405469 25781 raft_consensus.cc:1261] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Refusing update from remote peer 6b2afce15c7747b1a31987d9c5bf9894: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:40.405953 25924 consensus_queue.cc:1035] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:40.406147 25899 consensus_queue.cc:1035] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:40.409293 25897 tablet_replica.cc:439] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0: TxnStatusTablet state changed. Reason: New leader 6b2afce15c7747b1a31987d9c5bf9894. Latest consensus state: current_term: 1 leader_uuid: "6b2afce15c7747b1a31987d9c5bf9894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } } }
I20260809 02:25:40.409416 25897 tablet_replica.cc:442] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:40.411408 25930 mvcc.cc:205] Tried to move back new op lower bound from 7316448626293080064 to 7316448626188320768. Current Snapshot: MvccSnapshot[applied={T|T < 7316448626293080064}]
I20260809 02:25:40.411556 25924 tablet_replica.cc:439] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b2afce15c7747b1a31987d9c5bf9894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } } }
I20260809 02:25:40.411676 25924 tablet_replica.cc:442] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:25:40.411855 25898 tablet_replica.cc:439] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258: TxnStatusTablet state changed. Reason: New leader 6b2afce15c7747b1a31987d9c5bf9894. Latest consensus state: current_term: 1 leader_uuid: "6b2afce15c7747b1a31987d9c5bf9894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } } }
I20260809 02:25:40.411980 25898 tablet_replica.cc:442] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:40.412549 25897 tablet_replica.cc:439] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6b2afce15c7747b1a31987d9c5bf9894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } } }
I20260809 02:25:40.412658 25897 tablet_replica.cc:442] T 949cf7aae2e2456ea76839327145aaae P fd82af5125954598a155769b2fb2bed0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:40.413851 25933 mvcc.cc:205] Tried to move back new op lower bound from 7316448626293080064 to 7316448626188320768. Current Snapshot: MvccSnapshot[applied={T|T < 7316448626293080064}]
I20260809 02:25:40.415364 25899 tablet_replica.cc:439] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6b2afce15c7747b1a31987d9c5bf9894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } } }
I20260809 02:25:40.415485 25899 tablet_replica.cc:442] T 949cf7aae2e2456ea76839327145aaae P 6b2afce15c7747b1a31987d9c5bf9894: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:25:40.417392 25898 tablet_replica.cc:439] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6b2afce15c7747b1a31987d9c5bf9894" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } } }
I20260809 02:25:40.417511 25898 tablet_replica.cc:442] T 949cf7aae2e2456ea76839327145aaae P b3cbf0e587464ab29cbf2002a0ed2258: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:25:40.421341 25937 mvcc.cc:205] Tried to move back new op lower bound from 7316448626293080064 to 7316448626188320768. Current Snapshot: MvccSnapshot[applied={T|T < 7316448626293080064}]
I20260809 02:25:40.424496 25886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.420210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57086 (local address 127.21.214.130:39637)
0809 02:25:40.420336 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:40.420340 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:40.420602 (+ 262us) server_negotiation.cc:407] Connection header received
0809 02:25:40.420779 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:40.420782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:40.420843 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:40.420952 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:40.421193 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.421924 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.423120 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.423354 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.423463 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.423748 (+ 285us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:40.424125 (+ 377us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:40.424250 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:40.424316 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 02:25:40.424367 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:25:40.436183 25950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.431999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:42957 (local address 127.21.214.130:35609)
0809 02:25:40.432343 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:40.432356 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:40.432447 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:40.432699 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:40.432701 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:40.432706 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:25:40.432795 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.432798 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.433908 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.433931 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.434752 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.434762 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.435394 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.435397 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.435485 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.435529 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:25:40.435896 (+ 367us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:25:40.435902 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:25:40.435961 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 02:25:40.436038 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":148,"threads_started":1}
I20260809 02:25:40.436196 25887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.432088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:35609 (local address 127.21.214.129:42957)
0809 02:25:40.432215 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:40.432220 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:40.432431 (+ 211us) server_negotiation.cc:407] Connection header received
0809 02:25:40.432536 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:40.432539 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:40.432595 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:40.432684 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:40.432909 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.433797 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.434867 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.435257 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.435373 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.435717 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:40.435800 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:40.435879 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:40.436000 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 02:25:40.436062 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:25:40.443032 25781 raft_consensus.cc:1261] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Refusing update from remote peer fd82af5125954598a155769b2fb2bed0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:40.443200 25370 raft_consensus.cc:1261] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Refusing update from remote peer fd82af5125954598a155769b2fb2bed0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:40.443565 25902 consensus_queue.cc:1035] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:40.443753 25897 consensus_queue.cc:1035] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:40.468827 25961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.464845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:39637 (local address 127.21.214.129:41421)
0809 02:25:40.465250 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:40.465264 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:40.465400 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:40.465672 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:40.465675 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:40.465684 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:25:40.465815 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.465820 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.466749 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.466753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.467597 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:40.467608 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.468070 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.468074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:40.468183 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.468226 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:25:40.468528 (+ 302us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:25:40.468538 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 02:25:40.468603 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:25:40.468680 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":106,"threads_started":1}
I20260809 02:25:40.468811 25886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:40.464925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:41421 (local address 127.21.214.130:39637)
0809 02:25:40.465065 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:40.465068 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:40.465341 (+ 273us) server_negotiation.cc:407] Connection header received
0809 02:25:40.465511 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:40.465515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:40.465562 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:40.465661 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:40.465920 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.466627 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.467724 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:40.467951 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:40.468056 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:40.468363 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:40.468443 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:40.468521 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:40.468613 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 02:25:40.468669 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:25:40.496796 25123 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:40.496999 25123 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:40.499497 25123 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493: Sending DeleteTablet for 3 replicas of tablet 1b6c1ba789ed452db301b776d43926ee
I20260809 02:25:40.500253 25338 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b6c1ba789ed452db301b776d43926ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:40 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:34554
I20260809 02:25:40.500751 25752 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b6c1ba789ed452db301b776d43926ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:40 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:42006
I20260809 02:25:40.501235 25550 tablet_service.cc:1514] Processing DeleteTablet for tablet 1b6c1ba789ed452db301b776d43926ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:40 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:57084
I20260809 02:25:40.501843 25966 tablet_replica.cc:330] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0: stopping tablet replica
I20260809 02:25:40.502164 25966 raft_consensus.cc:2229] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:25:40.502583 25966 raft_consensus.cc:2258] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:40.502607 25123 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:25:40.503019 25123 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:25:40.504019 25966 ts_tablet_manager.cc:1905] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:40.507336 25966 ts_tablet_manager.cc:1918] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:25:40.507436 25966 log.cc:1196] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/1b6c1ba789ed452db301b776d43926ee
I20260809 02:25:40.507771 25966 ts_tablet_manager.cc:1939] T 1b6c1ba789ed452db301b776d43926ee P fd82af5125954598a155769b2fb2bed0: Deleting consensus metadata
I20260809 02:25:40.508752 25550 tablet_service.cc:1467] Processing CreateTablet for tablet 5ecb739cb33147858ac2698e36494fc9 (DEFAULT_TABLE table=test-table [id=97d360b32e9243728ba8cbec62efa6aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:40.508915 25752 tablet_service.cc:1467] Processing CreateTablet for tablet 5ecb739cb33147858ac2698e36494fc9 (DEFAULT_TABLE table=test-table [id=97d360b32e9243728ba8cbec62efa6aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:40.508993 25550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ecb739cb33147858ac2698e36494fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:40.509212 25752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ecb739cb33147858ac2698e36494fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:40.510598 25965 tablet_replica.cc:330] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258: stopping tablet replica
I20260809 02:25:40.510923 25965 raft_consensus.cc:2229] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:40.511152 25965 raft_consensus.cc:2258] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:40.511286 25891 tablet_bootstrap.cc:492] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0: Bootstrap starting.
I20260809 02:25:40.511837 25893 tablet_bootstrap.cc:492] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258: Bootstrap starting.
I20260809 02:25:40.512284 25891 tablet_bootstrap.cc:654] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:40.512588 25965 ts_tablet_manager.cc:1905] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:40.512753 25893 tablet_bootstrap.cc:654] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:40.513541 25105 catalog_manager.cc:4841] TS fd82af5125954598a155769b2fb2bed0 (127.21.214.130:39637): tablet 1b6c1ba789ed452db301b776d43926ee (table test-table [id=995673c19c8c4027957bde0176905668]) successfully deleted
I20260809 02:25:40.514652 25893 tablet_bootstrap.cc:492] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258: No bootstrap required, opened a new log
I20260809 02:25:40.514736 25893 ts_tablet_manager.cc:1397] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 02:25:40.514823 25891 tablet_bootstrap.cc:492] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0: No bootstrap required, opened a new log
I20260809 02:25:40.514906 25891 ts_tablet_manager.cc:1397] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260809 02:25:40.515156 25893 raft_consensus.cc:348] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.515264 25893 raft_consensus.cc:374] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:40.515293 25893 raft_consensus.cc:729] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbf0e587464ab29cbf2002a0ed2258, State: Initialized, Role: FOLLOWER
I20260809 02:25:40.515363 25891 raft_consensus.cc:348] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.515404 25893 consensus_queue.cc:260] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.515465 25891 raft_consensus.cc:374] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:40.515507 25891 raft_consensus.cc:729] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd82af5125954598a155769b2fb2bed0, State: Initialized, Role: FOLLOWER
I20260809 02:25:40.515638 25893 ts_tablet_manager.cc:1428] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:25:40.515643 25891 consensus_queue.cc:260] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.515901 25965 ts_tablet_manager.cc:1918] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:25:40.515944 25891 ts_tablet_manager.cc:1428] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:25:40.516001 25965 log.cc:1196] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/1b6c1ba789ed452db301b776d43926ee
I20260809 02:25:40.516330 25965 ts_tablet_manager.cc:1939] T 1b6c1ba789ed452db301b776d43926ee P b3cbf0e587464ab29cbf2002a0ed2258: Deleting consensus metadata
I20260809 02:25:40.517576 25964 tablet_replica.cc:330] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894: stopping tablet replica
I20260809 02:25:40.517710 25103 catalog_manager.cc:4841] TS b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305): tablet 1b6c1ba789ed452db301b776d43926ee (table test-table [id=995673c19c8c4027957bde0176905668]) successfully deleted
I20260809 02:25:40.517877 25964 raft_consensus.cc:2229] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:40.518033 25964 raft_consensus.cc:2258] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:40.519358 25964 ts_tablet_manager.cc:1905] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:40.520530 25338 tablet_service.cc:1467] Processing CreateTablet for tablet 5ecb739cb33147858ac2698e36494fc9 (DEFAULT_TABLE table=test-table [id=97d360b32e9243728ba8cbec62efa6aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:40.520805 25338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ecb739cb33147858ac2698e36494fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:40.522395 25964 ts_tablet_manager.cc:1918] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:25:40.522537 25964 log.cc:1196] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/wal/wals/1b6c1ba789ed452db301b776d43926ee
I20260809 02:25:40.522867 25964 ts_tablet_manager.cc:1939] T 1b6c1ba789ed452db301b776d43926ee P 6b2afce15c7747b1a31987d9c5bf9894: Deleting consensus metadata
I20260809 02:25:40.524075 25106 catalog_manager.cc:4841] TS 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957): tablet 1b6c1ba789ed452db301b776d43926ee (table test-table [id=995673c19c8c4027957bde0176905668]) successfully deleted
I20260809 02:25:40.524705 25892 tablet_bootstrap.cc:492] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894: Bootstrap starting.
I20260809 02:25:40.525715 25892 tablet_bootstrap.cc:654] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:40.527312 25892 tablet_bootstrap.cc:492] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894: No bootstrap required, opened a new log
I20260809 02:25:40.527398 25892 ts_tablet_manager.cc:1397] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260809 02:25:40.528198 25892 raft_consensus.cc:348] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.528330 25892 raft_consensus.cc:374] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:40.528363 25892 raft_consensus.cc:729] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b2afce15c7747b1a31987d9c5bf9894, State: Initialized, Role: FOLLOWER
I20260809 02:25:40.528499 25892 consensus_queue.cc:260] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.528766 25892 ts_tablet_manager.cc:1428] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260809 02:25:40.704006 25902 raft_consensus.cc:482] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:25:40.704172 25902 raft_consensus.cc:504] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.704704 25902 leader_election.cc:288] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957), b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305)
I20260809 02:25:40.705253 25370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ecb739cb33147858ac2698e36494fc9" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2afce15c7747b1a31987d9c5bf9894" is_pre_election: true
I20260809 02:25:40.705299 25781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ecb739cb33147858ac2698e36494fc9" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" is_pre_election: true
I20260809 02:25:40.705453 25370 raft_consensus.cc:2454] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 0.
I20260809 02:25:40.705530 25781 raft_consensus.cc:2454] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 0.
I20260809 02:25:40.705830 25481 leader_election.cc:302] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b2afce15c7747b1a31987d9c5bf9894, fd82af5125954598a155769b2fb2bed0; no voters:
I20260809 02:25:40.706081 25902 raft_consensus.cc:2781] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:25:40.706139 25902 raft_consensus.cc:482] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:25:40.706166 25902 raft_consensus.cc:3037] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:40.707326 25902 raft_consensus.cc:504] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.707669 25902 leader_election.cc:288] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 election: Requested vote from peers 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957), b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305)
I20260809 02:25:40.708037 25370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ecb739cb33147858ac2698e36494fc9" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2afce15c7747b1a31987d9c5bf9894"
I20260809 02:25:40.708155 25370 raft_consensus.cc:3037] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:40.708109 25781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ecb739cb33147858ac2698e36494fc9" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbf0e587464ab29cbf2002a0ed2258"
I20260809 02:25:40.708271 25781 raft_consensus.cc:3037] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:40.709072 25370 raft_consensus.cc:2454] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 1.
I20260809 02:25:40.709348 25781 raft_consensus.cc:2454] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 1.
I20260809 02:25:40.709404 25481 leader_election.cc:302] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b2afce15c7747b1a31987d9c5bf9894, fd82af5125954598a155769b2fb2bed0; no voters:
I20260809 02:25:40.709589 25902 raft_consensus.cc:2781] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:40.709715 25902 raft_consensus.cc:686] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [term 1 LEADER]: Becoming Leader. State: Replica: fd82af5125954598a155769b2fb2bed0, State: Running, Role: LEADER
I20260809 02:25:40.709919 25902 consensus_queue.cc:237] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:40.711702 25120 catalog_manager.cc:5495] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd82af5125954598a155769b2fb2bed0 (127.21.214.130). New cstate: current_term: 1 leader_uuid: "fd82af5125954598a155769b2fb2bed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } health_report { overall_health: UNKNOWN } } }
I20260809 02:25:40.730074 25370 raft_consensus.cc:1261] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Refusing update from remote peer fd82af5125954598a155769b2fb2bed0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:40.730197 25781 raft_consensus.cc:1261] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Refusing update from remote peer fd82af5125954598a155769b2fb2bed0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:40.730604 25902 consensus_queue.cc:1035] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:40.730825 25897 consensus_queue.cc:1035] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 02:25:40.744997 25933 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 02:25:42.299149 25123 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:42.299317 25123 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:42.301631 25123 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493: Sending DeleteTablet for 3 replicas of tablet 5ecb739cb33147858ac2698e36494fc9
I20260809 02:25:42.302238 25338 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ecb739cb33147858ac2698e36494fc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:42 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:34554
I20260809 02:25:42.302238 25752 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ecb739cb33147858ac2698e36494fc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:42 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:42006
I20260809 02:25:42.302238 25550 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ecb739cb33147858ac2698e36494fc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:42 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:57084
I20260809 02:25:42.302623 26009 tablet_replica.cc:330] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894: stopping tablet replica
I20260809 02:25:42.302675 26011 tablet_replica.cc:330] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0: stopping tablet replica
I20260809 02:25:42.302753 26009 raft_consensus.cc:2229] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:42.302668 26010 tablet_replica.cc:330] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258: stopping tablet replica
I20260809 02:25:42.302846 26011 raft_consensus.cc:2229] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:25:42.302875 26009 raft_consensus.cc:2258] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:42.303050 26010 raft_consensus.cc:2229] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:42.303251 26011 raft_consensus.cc:2258] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:42.303218 26010 raft_consensus.cc:2258] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:42.303848 26009 ts_tablet_manager.cc:1905] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:42.304199 26010 ts_tablet_manager.cc:1905] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:42.306372 26011 ts_tablet_manager.cc:1905] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:42.306900 26009 ts_tablet_manager.cc:1918] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:25:42.306994 26009 log.cc:1196] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/wal/wals/5ecb739cb33147858ac2698e36494fc9
I20260809 02:25:42.307116 26010 ts_tablet_manager.cc:1918] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:25:42.307232 26010 log.cc:1196] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/5ecb739cb33147858ac2698e36494fc9
I20260809 02:25:42.307293 26009 ts_tablet_manager.cc:1939] T 5ecb739cb33147858ac2698e36494fc9 P 6b2afce15c7747b1a31987d9c5bf9894: Deleting consensus metadata
I20260809 02:25:42.307611 26010 ts_tablet_manager.cc:1939] T 5ecb739cb33147858ac2698e36494fc9 P b3cbf0e587464ab29cbf2002a0ed2258: Deleting consensus metadata
I20260809 02:25:42.308048 25106 catalog_manager.cc:4841] TS 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957): tablet 5ecb739cb33147858ac2698e36494fc9 (table test-table [id=97d360b32e9243728ba8cbec62efa6aa]) successfully deleted
I20260809 02:25:42.308346 25103 catalog_manager.cc:4841] TS b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305): tablet 5ecb739cb33147858ac2698e36494fc9 (table test-table [id=97d360b32e9243728ba8cbec62efa6aa]) successfully deleted
I20260809 02:25:42.309343 26011 ts_tablet_manager.cc:1918] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:25:42.309410 26011 log.cc:1196] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/5ecb739cb33147858ac2698e36494fc9
I20260809 02:25:42.309633 26011 ts_tablet_manager.cc:1939] T 5ecb739cb33147858ac2698e36494fc9 P fd82af5125954598a155769b2fb2bed0: Deleting consensus metadata
I20260809 02:25:42.310182 25105 catalog_manager.cc:4841] TS fd82af5125954598a155769b2fb2bed0 (127.21.214.130:39637): tablet 5ecb739cb33147858ac2698e36494fc9 (table test-table [id=97d360b32e9243728ba8cbec62efa6aa]) successfully deleted
Aug 09 02:25:42 dist-test-slave-68xk krb5kdc[25058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242342, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:25:42 dist-test-slave-68xk krb5kdc[25058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242342, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:42.334735 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:42.326210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41896 (local address 127.21.214.190:45791)
0809 02:25:42.326537 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:42.326545 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:42.326559 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:25:42.326687 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:42.326690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:42.326740 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:42.326825 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:42.327609 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.328175 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.329066 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.329289 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.329368 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:42.331818 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:42.331821 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:42.331823 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:42.331846 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:42.333202 (+ 1356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:42.333594 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:42.333597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:42.333598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:42.333675 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:42.333921 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:42.333923 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:42.333924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:42.334095 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:42.334199 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:42.334459 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 02:25:42.334594 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":104,"threads_started":1}
I20260809 02:25:42.337280 25123 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41896:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:25:42.337692 25123 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:25:42.342317 25338 tablet_service.cc:1467] Processing CreateTablet for tablet e626c6e556074441a39eaa97a1263d5d (DEFAULT_TABLE table=test-table [id=6154976bf50e4cedb1a90af7d3506156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:42.342377 25550 tablet_service.cc:1467] Processing CreateTablet for tablet e626c6e556074441a39eaa97a1263d5d (DEFAULT_TABLE table=test-table [id=6154976bf50e4cedb1a90af7d3506156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:42.342576 25752 tablet_service.cc:1467] Processing CreateTablet for tablet e626c6e556074441a39eaa97a1263d5d (DEFAULT_TABLE table=test-table [id=6154976bf50e4cedb1a90af7d3506156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:42.342669 25338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e626c6e556074441a39eaa97a1263d5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:42.342669 25550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e626c6e556074441a39eaa97a1263d5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:42.342918 25752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e626c6e556074441a39eaa97a1263d5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:42.345428 26027 tablet_bootstrap.cc:492] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0: Bootstrap starting.
I20260809 02:25:42.345428 26026 tablet_bootstrap.cc:492] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258: Bootstrap starting.
I20260809 02:25:42.345754 26028 tablet_bootstrap.cc:492] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894: Bootstrap starting.
I20260809 02:25:42.346447 26026 tablet_bootstrap.cc:654] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:42.346447 26027 tablet_bootstrap.cc:654] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:42.346637 26028 tablet_bootstrap.cc:654] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:42.347705 26026 tablet_bootstrap.cc:492] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258: No bootstrap required, opened a new log
I20260809 02:25:42.347745 26027 tablet_bootstrap.cc:492] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0: No bootstrap required, opened a new log
I20260809 02:25:42.347831 26026 ts_tablet_manager.cc:1397] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:42.347841 26027 ts_tablet_manager.cc:1397] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:42.348304 26027 raft_consensus.cc:348] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.348331 26026 raft_consensus.cc:348] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.348469 26027 raft_consensus.cc:374] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:42.348474 26026 raft_consensus.cc:374] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:42.348516 26026 raft_consensus.cc:729] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbf0e587464ab29cbf2002a0ed2258, State: Initialized, Role: FOLLOWER
I20260809 02:25:42.348516 26027 raft_consensus.cc:729] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd82af5125954598a155769b2fb2bed0, State: Initialized, Role: FOLLOWER
I20260809 02:25:42.348665 26027 consensus_queue.cc:260] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.348675 26026 consensus_queue.cc:260] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.348958 26027 ts_tablet_manager.cc:1428] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:25:42.349088 26026 ts_tablet_manager.cc:1428] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 02:25:42.349984 26028 tablet_bootstrap.cc:492] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894: No bootstrap required, opened a new log
I20260809 02:25:42.350083 26028 ts_tablet_manager.cc:1397] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260809 02:25:42.350591 26028 raft_consensus.cc:348] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.350709 26028 raft_consensus.cc:374] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:42.350751 26028 raft_consensus.cc:729] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b2afce15c7747b1a31987d9c5bf9894, State: Initialized, Role: FOLLOWER
I20260809 02:25:42.350883 26028 consensus_queue.cc:260] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.351176 26028 ts_tablet_manager.cc:1428] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:25:42.756717 25979 raft_consensus.cc:482] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:25:42.756866 25979 raft_consensus.cc:504] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.757470 25979 leader_election.cc:288] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957), b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305)
I20260809 02:25:42.758050 25781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e626c6e556074441a39eaa97a1263d5d" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" is_pre_election: true
I20260809 02:25:42.758051 25370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e626c6e556074441a39eaa97a1263d5d" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2afce15c7747b1a31987d9c5bf9894" is_pre_election: true
I20260809 02:25:42.758220 25781 raft_consensus.cc:2454] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 0.
I20260809 02:25:42.758220 25370 raft_consensus.cc:2454] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 0.
I20260809 02:25:42.758618 25479 leader_election.cc:302] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3cbf0e587464ab29cbf2002a0ed2258, fd82af5125954598a155769b2fb2bed0; no voters:
I20260809 02:25:42.758890 25979 raft_consensus.cc:2781] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:25:42.758941 25979 raft_consensus.cc:482] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:25:42.758970 25979 raft_consensus.cc:3037] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:42.760031 25979 raft_consensus.cc:504] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.760432 25979 leader_election.cc:288] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 election: Requested vote from peers 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957), b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305)
I20260809 02:25:42.760769 25370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e626c6e556074441a39eaa97a1263d5d" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2afce15c7747b1a31987d9c5bf9894"
I20260809 02:25:42.760906 25370 raft_consensus.cc:3037] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:42.760911 25781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e626c6e556074441a39eaa97a1263d5d" candidate_uuid: "fd82af5125954598a155769b2fb2bed0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cbf0e587464ab29cbf2002a0ed2258"
I20260809 02:25:42.761058 25781 raft_consensus.cc:3037] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:42.761945 25370 raft_consensus.cc:2454] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 1.
I20260809 02:25:42.762168 25781 raft_consensus.cc:2454] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fd82af5125954598a155769b2fb2bed0 in term 1.
I20260809 02:25:42.762259 25481 leader_election.cc:302] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b2afce15c7747b1a31987d9c5bf9894, fd82af5125954598a155769b2fb2bed0; no voters:
I20260809 02:25:42.762609 25979 raft_consensus.cc:2781] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:42.762728 25979 raft_consensus.cc:686] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [term 1 LEADER]: Becoming Leader. State: Replica: fd82af5125954598a155769b2fb2bed0, State: Running, Role: LEADER
I20260809 02:25:42.762882 25979 consensus_queue.cc:237] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.764649 25123 catalog_manager.cc:5495] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 reported cstate change: term changed from 0 to 1, leader changed from <none> to fd82af5125954598a155769b2fb2bed0 (127.21.214.130). New cstate: current_term: 1 leader_uuid: "fd82af5125954598a155769b2fb2bed0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } health_report { overall_health: UNKNOWN } } }
I20260809 02:25:42.806912 26058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:42.803522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59838 (local address 127.21.214.130:39637)
0809 02:25:42.803725 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:42.803728 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:42.803741 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:25:42.803851 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:42.803854 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:42.803912 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:42.803988 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:42.804263 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.804877 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.805799 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.806020 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.806134 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:42.806396 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:42.806530 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:42.806613 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:42.806704 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 02:25:42.806757 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":72,"threads_started":1}
I20260809 02:25:42.812757 25370 raft_consensus.cc:1261] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Refusing update from remote peer fd82af5125954598a155769b2fb2bed0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:42.812877 25781 raft_consensus.cc:1261] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Refusing update from remote peer fd82af5125954598a155769b2fb2bed0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:42.813197 25979 consensus_queue.cc:1035] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:42.813346 25999 consensus_queue.cc:1035] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:42.845228 25120 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:42.845412 25120 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:42.847395 25120 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493: Sending DeleteTablet for 3 replicas of tablet e626c6e556074441a39eaa97a1263d5d
I20260809 02:25:42.847957 25338 tablet_service.cc:1514] Processing DeleteTablet for tablet e626c6e556074441a39eaa97a1263d5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:42 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:34554
I20260809 02:25:42.848066 25550 tablet_service.cc:1514] Processing DeleteTablet for tablet e626c6e556074441a39eaa97a1263d5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:42 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:57084
I20260809 02:25:42.848052 25752 tablet_service.cc:1514] Processing DeleteTablet for tablet e626c6e556074441a39eaa97a1263d5d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:42 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:42006
I20260809 02:25:42.848371 26069 tablet_replica.cc:330] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258: stopping tablet replica
I20260809 02:25:42.848377 26066 tablet_replica.cc:330] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0: stopping tablet replica
I20260809 02:25:42.848524 26066 raft_consensus.cc:2229] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:25:42.848526 26069 raft_consensus.cc:2229] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:42.848670 26069 raft_consensus.cc:2258] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:42.848719 26066 raft_consensus.cc:2258] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:42.849013 26065 tablet_replica.cc:330] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894: stopping tablet replica
I20260809 02:25:42.849155 26065 raft_consensus.cc:2229] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:42.849280 26065 raft_consensus.cc:2258] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:42.849290 25120 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41896:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 02:25:42.849572 26066 ts_tablet_manager.cc:1905] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:42.849699 26069 ts_tablet_manager.cc:1905] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 02:25:42.849979 25120 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:25:42.850040 26065 ts_tablet_manager.cc:1905] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:42.852587 26069 ts_tablet_manager.cc:1918] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:25:42.852671 26069 log.cc:1196] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/e626c6e556074441a39eaa97a1263d5d
I20260809 02:25:42.852708 26066 ts_tablet_manager.cc:1918] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:25:42.852793 26066 log.cc:1196] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/e626c6e556074441a39eaa97a1263d5d
I20260809 02:25:42.852970 26069 ts_tablet_manager.cc:1939] T e626c6e556074441a39eaa97a1263d5d P b3cbf0e587464ab29cbf2002a0ed2258: Deleting consensus metadata
I20260809 02:25:42.853124 26066 ts_tablet_manager.cc:1939] T e626c6e556074441a39eaa97a1263d5d P fd82af5125954598a155769b2fb2bed0: Deleting consensus metadata
I20260809 02:25:42.853215 26065 ts_tablet_manager.cc:1918] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:25:42.853284 26065 log.cc:1196] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-0/wal/wals/e626c6e556074441a39eaa97a1263d5d
I20260809 02:25:42.853540 26065 ts_tablet_manager.cc:1939] T e626c6e556074441a39eaa97a1263d5d P 6b2afce15c7747b1a31987d9c5bf9894: Deleting consensus metadata
I20260809 02:25:42.853734 25103 catalog_manager.cc:4841] TS b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305): tablet e626c6e556074441a39eaa97a1263d5d (table test-table [id=6154976bf50e4cedb1a90af7d3506156]) successfully deleted
I20260809 02:25:42.854005 25105 catalog_manager.cc:4841] TS fd82af5125954598a155769b2fb2bed0 (127.21.214.130:39637): tablet e626c6e556074441a39eaa97a1263d5d (table test-table [id=6154976bf50e4cedb1a90af7d3506156]) successfully deleted
I20260809 02:25:42.854243 25106 catalog_manager.cc:4841] TS 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957): tablet e626c6e556074441a39eaa97a1263d5d (table test-table [id=6154976bf50e4cedb1a90af7d3506156]) successfully deleted
I20260809 02:25:42.855170 25550 tablet_service.cc:1467] Processing CreateTablet for tablet f667513f866e4a868c29abbfb558c0ab (DEFAULT_TABLE table=test-table [id=46912f0782194513bec01bd2ac350be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:42.855258 25338 tablet_service.cc:1467] Processing CreateTablet for tablet f667513f866e4a868c29abbfb558c0ab (DEFAULT_TABLE table=test-table [id=46912f0782194513bec01bd2ac350be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:42.855463 25550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f667513f866e4a868c29abbfb558c0ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:42.855545 25338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f667513f866e4a868c29abbfb558c0ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:42.857465 26070 tablet_bootstrap.cc:492] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0: Bootstrap starting.
I20260809 02:25:42.857921 26072 tablet_bootstrap.cc:492] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894: Bootstrap starting.
I20260809 02:25:42.857999 25752 tablet_service.cc:1467] Processing CreateTablet for tablet f667513f866e4a868c29abbfb558c0ab (DEFAULT_TABLE table=test-table [id=46912f0782194513bec01bd2ac350be8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:42.858270 25752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f667513f866e4a868c29abbfb558c0ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:42.858623 26070 tablet_bootstrap.cc:654] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:42.858923 26072 tablet_bootstrap.cc:654] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:42.859844 26070 tablet_bootstrap.cc:492] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0: No bootstrap required, opened a new log
I20260809 02:25:42.859963 26070 ts_tablet_manager.cc:1397] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:25:42.860321 26070 raft_consensus.cc:348] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.860445 26070 raft_consensus.cc:374] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:42.860491 26070 raft_consensus.cc:729] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd82af5125954598a155769b2fb2bed0, State: Initialized, Role: FOLLOWER
I20260809 02:25:42.860628 26075 tablet_bootstrap.cc:492] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258: Bootstrap starting.
I20260809 02:25:42.860625 26070 consensus_queue.cc:260] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.860956 26070 ts_tablet_manager.cc:1428] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:25:42.861508 26072 tablet_bootstrap.cc:492] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894: No bootstrap required, opened a new log
I20260809 02:25:42.861617 26072 ts_tablet_manager.cc:1397] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260809 02:25:42.861651 26075 tablet_bootstrap.cc:654] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:42.862075 26072 raft_consensus.cc:348] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.862200 26072 raft_consensus.cc:374] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:42.862249 26072 raft_consensus.cc:729] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b2afce15c7747b1a31987d9c5bf9894, State: Initialized, Role: FOLLOWER
I20260809 02:25:42.862440 26072 consensus_queue.cc:260] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.862825 26072 ts_tablet_manager.cc:1428] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:25:42.863570 26075 tablet_bootstrap.cc:492] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258: No bootstrap required, opened a new log
I20260809 02:25:42.863656 26075 ts_tablet_manager.cc:1397] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:25:42.864127 26075 raft_consensus.cc:348] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.864251 26075 raft_consensus.cc:374] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:42.864310 26075 raft_consensus.cc:729] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cbf0e587464ab29cbf2002a0ed2258, State: Initialized, Role: FOLLOWER
I20260809 02:25:42.864441 26075 consensus_queue.cc:260] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.864745 26075 ts_tablet_manager.cc:1428] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:25:42.892987 26033 raft_consensus.cc:482] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:25:42.893121 26033 raft_consensus.cc:504] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.894138 26033 leader_election.cc:288] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957), fd82af5125954598a155769b2fb2bed0 (127.21.214.130:39637)
I20260809 02:25:42.898530 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:42.894367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:39637 (local address 127.21.214.131:36995)
0809 02:25:42.894788 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:42.894805 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:42.894937 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:42.895211 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:42.895214 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:42.895232 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:42.895383 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:42.895389 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.896419 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.896422 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:42.897283 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:42.897293 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.898037 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.898044 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:42.898149 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:42.898172 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:25:42.898248 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:25:42.898306 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"mutex_wait_us":39,"thread_start_us":134,"threads_started":1}
I20260809 02:25:42.898543 26058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:42.894622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:36995 (local address 127.21.214.130:39637)
0809 02:25:42.894779 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:42.894784 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:42.894896 (+ 112us) server_negotiation.cc:407] Connection header received
0809 02:25:42.895063 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:42.895072 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:42.895115 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:42.895174 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:42.895500 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.896210 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.897410 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.897916 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.898013 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:42.898083 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:42.898303 (+ 220us) server_negotiation.cc:299] Negotiation successful
0809 02:25:42.898392 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 02:25:42.898622 26082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:42.894367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:42957 (local address 127.21.214.131:34523)
0809 02:25:42.894802 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:42.894816 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:42.894950 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:42.895237 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:42.895240 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:42.895271 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:42.895401 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:42.895406 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.896372 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.896376 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:42.897261 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:42.897270 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.898127 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.898131 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:42.898253 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:42.898286 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 02:25:42.898359 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 02:25:42.898447 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":118,"spinlock_wait_cycles":3712,"thread_start_us":102,"threads_started":1}
I20260809 02:25:42.898648 26083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:42.894502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:34523 (local address 127.21.214.129:42957)
0809 02:25:42.894761 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:42.894776 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:42.894929 (+ 153us) server_negotiation.cc:407] Connection header received
0809 02:25:42.895062 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:42.895065 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:42.895114 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:42.895211 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:42.895534 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.896238 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.897384 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.897998 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.898119 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:42.898171 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:42.898393 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 02:25:42.898496 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":70,"threads_started":1}
I20260809 02:25:42.898950 25575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f667513f866e4a868c29abbfb558c0ab" candidate_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd82af5125954598a155769b2fb2bed0" is_pre_election: true
I20260809 02:25:42.899109 25575 raft_consensus.cc:2454] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbf0e587464ab29cbf2002a0ed2258 in term 0.
I20260809 02:25:42.899132 25370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f667513f866e4a868c29abbfb558c0ab" candidate_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2afce15c7747b1a31987d9c5bf9894" is_pre_election: true
I20260809 02:25:42.899318 25370 raft_consensus.cc:2454] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3cbf0e587464ab29cbf2002a0ed2258 in term 0.
I20260809 02:25:42.899526 25690 leader_election.cc:302] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3cbf0e587464ab29cbf2002a0ed2258, fd82af5125954598a155769b2fb2bed0; no voters:
I20260809 02:25:42.899838 26033 raft_consensus.cc:2781] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:25:42.899896 26033 raft_consensus.cc:482] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:25:42.899923 26033 raft_consensus.cc:3037] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:42.901024 26033 raft_consensus.cc:504] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.901425 26033 leader_election.cc:288] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [CANDIDATE]: Term 1 election: Requested vote from peers 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957), fd82af5125954598a155769b2fb2bed0 (127.21.214.130:39637)
I20260809 02:25:42.901738 25370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f667513f866e4a868c29abbfb558c0ab" candidate_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2afce15c7747b1a31987d9c5bf9894"
I20260809 02:25:42.901893 25370 raft_consensus.cc:3037] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:42.901893 25575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f667513f866e4a868c29abbfb558c0ab" candidate_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fd82af5125954598a155769b2fb2bed0"
I20260809 02:25:42.902033 25575 raft_consensus.cc:3037] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:42.902982 25370 raft_consensus.cc:2454] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbf0e587464ab29cbf2002a0ed2258 in term 1.
I20260809 02:25:42.903211 25575 raft_consensus.cc:2454] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3cbf0e587464ab29cbf2002a0ed2258 in term 1.
I20260809 02:25:42.903282 25691 leader_election.cc:302] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b2afce15c7747b1a31987d9c5bf9894, b3cbf0e587464ab29cbf2002a0ed2258; no voters:
I20260809 02:25:42.903503 26033 raft_consensus.cc:2781] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:42.903755 26033 raft_consensus.cc:686] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 LEADER]: Becoming Leader. State: Replica: b3cbf0e587464ab29cbf2002a0ed2258, State: Running, Role: LEADER
I20260809 02:25:42.904042 26033 consensus_queue.cc:237] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } }
I20260809 02:25:42.906630 25123 catalog_manager.cc:5495] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131). New cstate: current_term: 1 leader_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cbf0e587464ab29cbf2002a0ed2258" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34305 } health_report { overall_health: HEALTHY } } }
I20260809 02:25:42.932698 26089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:42.928376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54804 (local address 127.21.214.131:34305)
0809 02:25:42.928692 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:42.928701 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:42.928721 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:25:42.928801 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:42.928803 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:42.928857 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:42.928995 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:42.929252 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.930253 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.931155 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.931404 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.931522 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:42.931805 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:42.932270 (+ 465us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:42.932405 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:42.932465 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 02:25:42.932520 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":113,"threads_started":1}
I20260809 02:25:42.943106 26083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:42.939594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:42637 (local address 127.21.214.129:42957)
0809 02:25:42.939750 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:42.939755 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:42.939902 (+ 147us) server_negotiation.cc:407] Connection header received
0809 02:25:42.940053 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:42.940056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:42.940108 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:42.940183 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:42.940436 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.940940 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.941938 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.942171 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.942307 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:42.942663 (+ 356us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:42.942738 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:42.942819 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:42.942907 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 02:25:42.942961 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 02:25:42.943135 26093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:42.939442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:42957 (local address 127.21.214.131:42637)
0809 02:25:42.939820 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:42.939832 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:42.939954 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:42.940205 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:42.940208 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:42.940216 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:25:42.940332 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:42.940337 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.941048 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.941052 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:42.941816 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:42.941826 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.942326 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.942329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:42.942475 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:42.942526 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:25:42.942823 (+ 297us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:25:42.942832 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 02:25:42.942897 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:25:42.942979 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":125,"threads_started":1}
I20260809 02:25:42.949153 25370 raft_consensus.cc:1261] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894 [term 1 FOLLOWER]: Refusing update from remote peer b3cbf0e587464ab29cbf2002a0ed2258: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:42.949162 25575 raft_consensus.cc:1261] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Refusing update from remote peer b3cbf0e587464ab29cbf2002a0ed2258: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:42.949680 26033 consensus_queue.cc:1035] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fd82af5125954598a155769b2fb2bed0" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:42.949908 26086 consensus_queue.cc:1035] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b2afce15c7747b1a31987d9c5bf9894" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:42.967492 26089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:42.964059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:42141 (local address 127.21.214.131:34305)
0809 02:25:42.964179 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:42.964184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:42.964435 (+ 251us) server_negotiation.cc:407] Connection header received
0809 02:25:42.964559 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:42.964562 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:42.964606 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:42.964694 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:42.964949 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.965479 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.966400 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.966665 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.966800 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:42.967059 (+ 259us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:42.967138 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:42.967218 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:42.967309 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 02:25:42.967361 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:25:42.967514 26098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:42.964014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:34305 (local address 127.21.214.129:42141)
0809 02:25:42.964352 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:42.964367 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:42.964475 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:42.964705 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:42.964708 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:42.964715 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:25:42.964830 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:42.964836 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.965595 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.965600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:42.966272 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:42.966281 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:42.966804 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:42.966807 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:42.966895 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:42.966932 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:25:42.967223 (+ 291us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:25:42.967232 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 02:25:42.967300 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 02:25:42.967382 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":108,"threads_started":1}
W20260809 02:25:42.968199 26042 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 02:25:44.534008 25121 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:44.534168 25121 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41896:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:44.536656 25121 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 699496ff98e04195bb7b79ee13e06493: Sending DeleteTablet for 3 replicas of tablet f667513f866e4a868c29abbfb558c0ab
I20260809 02:25:44.537269 25338 tablet_service.cc:1514] Processing DeleteTablet for tablet f667513f866e4a868c29abbfb558c0ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:44 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:34554
I20260809 02:25:44.537269 25550 tablet_service.cc:1514] Processing DeleteTablet for tablet f667513f866e4a868c29abbfb558c0ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:44 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:57084
I20260809 02:25:44.537374 25752 tablet_service.cc:1514] Processing DeleteTablet for tablet f667513f866e4a868c29abbfb558c0ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:44 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:42006
I20260809 02:25:44.537670 26135 tablet_replica.cc:330] T f667513f866e4a868c29abbfb558c0ab P 6b2afce15c7747b1a31987d9c5bf9894: stopping tablet replica
I20260809 02:25:44.537729 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 25236
I20260809 02:25:44.544152 26138 tablet_replica.cc:330] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258: stopping tablet replica
I20260809 02:25:44.544337 26138 raft_consensus.cc:2229] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:25:44.544696 26138 raft_consensus.cc:2258] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:44.545006 26136 tablet_replica.cc:330] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0: stopping tablet replica
I20260809 02:25:44.545163 26136 raft_consensus.cc:2229] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:44.545288 26136 raft_consensus.cc:2258] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:44.545401 26138 ts_tablet_manager.cc:1905] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:44.545956 26136 ts_tablet_manager.cc:1905] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:44.548393 26138 ts_tablet_manager.cc:1918] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:25:44.548486 26138 log.cc:1196] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/f667513f866e4a868c29abbfb558c0ab
I20260809 02:25:44.548844 26138 ts_tablet_manager.cc:1939] T f667513f866e4a868c29abbfb558c0ab P b3cbf0e587464ab29cbf2002a0ed2258: Deleting consensus metadata
I20260809 02:25:44.548823 26136 ts_tablet_manager.cc:1918] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 02:25:44.548910 26136 log.cc:1196] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/f667513f866e4a868c29abbfb558c0ab
I20260809 02:25:44.549183 26136 ts_tablet_manager.cc:1939] T f667513f866e4a868c29abbfb558c0ab P fd82af5125954598a155769b2fb2bed0: Deleting consensus metadata
I20260809 02:25:44.549763 25103 catalog_manager.cc:4841] TS b3cbf0e587464ab29cbf2002a0ed2258 (127.21.214.131:34305): tablet f667513f866e4a868c29abbfb558c0ab (table test-table [id=46912f0782194513bec01bd2ac350be8]) successfully deleted
I20260809 02:25:44.549927 25105 catalog_manager.cc:4841] TS fd82af5125954598a155769b2fb2bed0 (127.21.214.130:39637): tablet f667513f866e4a868c29abbfb558c0ab (table test-table [id=46912f0782194513bec01bd2ac350be8]) successfully deleted
W20260809 02:25:44.551900 25106 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:42957 (error 108)
I20260809 02:25:44.552711 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 25456
I20260809 02:25:44.559525 26143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:44.552684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:42957 (local address 127.0.0.1:45570)
0809 02:25:44.559274 (+ 6590us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:44.559377 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:42957: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6478,"thread_start_us":99,"threads_started":1}
W20260809 02:25:44.559648 25106 catalog_manager.cc:4584] TS 6b2afce15c7747b1a31987d9c5bf9894 (127.21.214.129:42957): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f667513f866e4a868c29abbfb558c0ab: Network error: Client connection negotiation failed: client connection to 127.21.214.129:42957: connect: Connection refused (error 111)
I20260809 02:25:44.571648 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 25665
I20260809 02:25:44.583254 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 25077
2026-08-09T02:25:44Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (7065 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:44 dist-test-slave-68xk krb5kdc[26148](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:44 dist-test-slave-68xk krb5kdc[26148](info): set up 2 sockets
Aug 09 02:25:44 dist-test-slave-68xk krb5kdc[26148](info): commencing operation
krb5kdc: starting...
W20260809 02:25:45.805416 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:25:45 dist-test-slave-68xk krb5kdc[26148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:25:45.937798 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:40355
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:40355
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:46.049389 26174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:46.049643 26174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:46.049685 26174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:46.053689 26174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:46.053757 26174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:46.053777 26174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:46.053793 26174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:46.053808 26174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:46.059053 26174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:40355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:40355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:46.060031 26174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:46.060984 26174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:25:46.069861 26174 server_base.cc:1034] running on GCE node
W20260809 02:25:46.069840 26191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:46.069831 26188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:46.069880 26189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:46.070725 26174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:46.071762 26174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:46.072947 26174 hybrid_clock.cc:648] HybridClock initialized: now 1786242346072921 us; error 38 us; skew 500 ppm
Aug 09 02:25:46 dist-test-slave-68xk krb5kdc[26148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242346, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:46.075680 26174 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:25:46.076614 26174 webserver.cc:460] Webserver started at http://127.21.214.190:44195/ using document root <none> and password file <none>
I20260809 02:25:46.077188 26174 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:46.077322 26174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:46.077564 26174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:46.079665 26174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "579c499271014dd09a65bd7a6f34d000"
format_stamp: "Formatted at 2026-08-09 02:25:46 on dist-test-slave-68xk"
server_key: "f847e3e329b6db27595e70efeaa6a2e9"
server_key_iv: "d27798d168c4ddc36a4511b9dc0f097e"
server_key_version: "encryptionkey@0"
I20260809 02:25:46.080242 26174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "579c499271014dd09a65bd7a6f34d000"
format_stamp: "Formatted at 2026-08-09 02:25:46 on dist-test-slave-68xk"
server_key: "f847e3e329b6db27595e70efeaa6a2e9"
server_key_iv: "d27798d168c4ddc36a4511b9dc0f097e"
server_key_version: "encryptionkey@0"
I20260809 02:25:46.084057 26174 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 02:25:46.086762 26208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:46.088071 26174 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:25:46.088225 26174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "579c499271014dd09a65bd7a6f34d000"
format_stamp: "Formatted at 2026-08-09 02:25:46 on dist-test-slave-68xk"
server_key: "f847e3e329b6db27595e70efeaa6a2e9"
server_key_iv: "d27798d168c4ddc36a4511b9dc0f097e"
server_key_version: "encryptionkey@0"
I20260809 02:25:46.088342 26174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:46.108999 26174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:46.111913 26174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:46.112121 26174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:46.119478 26174 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:40355
I20260809 02:25:46.119503 26283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:40355 every 8 connection(s)
I20260809 02:25:46.120399 26174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:46.123098 26284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:46.124270 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 26174
I20260809 02:25:46.124385 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:46.124698 22362 external_mini_cluster.cc:1428] Setting key d26dc9c9039cf10d73745ac5c08c88c3
I20260809 02:25:46.129158 26284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000: Bootstrap starting.
I20260809 02:25:46.131400 26284 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:46.132126 26284 log.cc:824] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:25:46 dist-test-slave-68xk krb5kdc[26148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:46.134258 26284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000: No bootstrap required, opened a new log
I20260809 02:25:46.137588 26284 raft_consensus.cc:348] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "579c499271014dd09a65bd7a6f34d000" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40355 } }
I20260809 02:25:46.137836 26284 raft_consensus.cc:374] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:46.137940 26284 raft_consensus.cc:729] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 579c499271014dd09a65bd7a6f34d000, State: Initialized, Role: FOLLOWER
I20260809 02:25:46.138485 26284 consensus_queue.cc:260] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "579c499271014dd09a65bd7a6f34d000" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40355 } }
I20260809 02:25:46.138656 26284 raft_consensus.cc:388] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:46.138733 26284 raft_consensus.cc:482] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:46.138844 26284 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:46.139289 26289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:46.126128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49108 (local address 127.21.214.190:40355)
0809 02:25:46.126611 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:46.126626 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:46.126659 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:25:46.127290 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:46.127307 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:46.127632 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:46.127963 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:46.128819 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.129842 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.130793 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.131248 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.131425 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:46.134383 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:46.134391 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:46.134410 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:46.134476 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:46.136220 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:46.136682 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:46.136687 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:46.136692 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:46.136807 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:46.137107 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:46.137110 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:46.137112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:46.137499 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:46.137724 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:46.137991 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 02:25:46.138328 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":135,"threads_started":1}
I20260809 02:25:46.139914 26284 raft_consensus.cc:504] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "579c499271014dd09a65bd7a6f34d000" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40355 } }
I20260809 02:25:46.140254 26284 leader_election.cc:302] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 579c499271014dd09a65bd7a6f34d000; no voters:
I20260809 02:25:46.140560 26284 leader_election.cc:288] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:46.140666 26293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:46.140867 26293 raft_consensus.cc:686] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [term 1 LEADER]: Becoming Leader. State: Replica: 579c499271014dd09a65bd7a6f34d000, State: Running, Role: LEADER
I20260809 02:25:46.141234 26293 consensus_queue.cc:237] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "579c499271014dd09a65bd7a6f34d000" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40355 } }
I20260809 02:25:46.141816 26284 sys_catalog.cc:564] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:46.142390 26293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 579c499271014dd09a65bd7a6f34d000. Latest consensus state: current_term: 1 leader_uuid: "579c499271014dd09a65bd7a6f34d000" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "579c499271014dd09a65bd7a6f34d000" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40355 } } }
I20260809 02:25:46.142611 26293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:46.142926 26296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "579c499271014dd09a65bd7a6f34d000" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "579c499271014dd09a65bd7a6f34d000" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40355 } } }
I20260809 02:25:46.143107 26296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:46.143054 26307 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:46.146292 26307 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:46.151889 26307 catalog_manager.cc:1347] Generated new cluster ID: 801b832d46fc4f9b9d74def5f36c55ad
I20260809 02:25:46.151952 26307 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:46.161397 26307 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:46.162575 26307 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:46.169179 26307 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 579c499271014dd09a65bd7a6f34d000: Generated new TSK 0
I20260809 02:25:46.169931 26307 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:25:46.207685 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40355
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:46.323638 26329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:46.323891 26329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:46.323935 26329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:46.327884 26329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:46.327939 26329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:46.327996 26329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:25:46.333058 26329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:46.334087 26329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:46.335072 26329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:46.344861 26337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:46.344869 26338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:46.344869 26341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:46.345021 26329 server_base.cc:1034] running on GCE node
I20260809 02:25:46.345609 26329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:46.346254 26329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:46.347415 26329 hybrid_clock.cc:648] HybridClock initialized: now 1786242346347406 us; error 32 us; skew 500 ppm
Aug 09 02:25:46 dist-test-slave-68xk krb5kdc[26148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242346, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:46.350246 26329 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:25:46.351150 26329 webserver.cc:460] Webserver started at http://127.21.214.129:33877/ using document root <none> and password file <none>
I20260809 02:25:46.351737 26329 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:46.351832 26329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:46.352072 26329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:46.354169 26329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "04279e6cbdee4a88b978f8ce9c15a61a"
format_stamp: "Formatted at 2026-08-09 02:25:46 on dist-test-slave-68xk"
server_key: "a887a61df5e6eda3e124d64a0395097f"
server_key_iv: "999e7c8429dba1a8210a3772011e9767"
server_key_version: "encryptionkey@0"
I20260809 02:25:46.354825 26329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "04279e6cbdee4a88b978f8ce9c15a61a"
format_stamp: "Formatted at 2026-08-09 02:25:46 on dist-test-slave-68xk"
server_key: "a887a61df5e6eda3e124d64a0395097f"
server_key_iv: "999e7c8429dba1a8210a3772011e9767"
server_key_version: "encryptionkey@0"
I20260809 02:25:46.358530 26329 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:25:46.361353 26349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:46.362574 26329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:25:46.362715 26329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "04279e6cbdee4a88b978f8ce9c15a61a"
format_stamp: "Formatted at 2026-08-09 02:25:46 on dist-test-slave-68xk"
server_key: "a887a61df5e6eda3e124d64a0395097f"
server_key_iv: "999e7c8429dba1a8210a3772011e9767"
server_key_version: "encryptionkey@0"
I20260809 02:25:46.362823 26329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:46.389750 26329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:46.392904 26329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:46.393116 26329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:46.393738 26329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:46.394694 26329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:46.394766 26329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:46.394832 26329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:46.394882 26329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:46.404685 26329 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:36249
I20260809 02:25:46.404733 26525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:36249 every 8 connection(s)
I20260809 02:25:46.405719 26329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:25:46.415177 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 26329
I20260809 02:25:46.415318 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:25:46.415642 22362 external_mini_cluster.cc:1428] Setting key 82ad8c37dfccc789cb0efc6029bf2355
Aug 09 02:25:46 dist-test-slave-68xk krb5kdc[26148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242346, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:46.420926 26289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:46.407616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:35727 (local address 127.21.214.190:40355)
0809 02:25:46.407761 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:46.407765 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:46.408721 (+ 956us) server_negotiation.cc:407] Connection header received
0809 02:25:46.410240 (+ 1519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:46.410244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:46.410308 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:46.410451 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:46.411738 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.412348 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.413665 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.413938 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.414062 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:46.417261 (+ 3199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:46.417265 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:46.417269 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:46.417297 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:46.418863 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:46.419398 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:46.419402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:46.419404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:46.419488 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:46.419843 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:46.419847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:46.419849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:46.420030 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:46.420141 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:46.420629 (+ 488us) server_negotiation.cc:299] Negotiation successful
0809 02:25:46.420756 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:25:46.421694 26529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:46.408001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40355 (local address 127.21.214.129:35727)
0809 02:25:46.408526 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:46.408575 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:46.409968 (+ 1393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:46.410639 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:46.410647 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:46.411059 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:46.411556 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:46.411569 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.412506 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.412516 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:46.413516 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:46.413527 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.414126 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.414131 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:46.414333 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:46.415048 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:46.415072 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:46.417088 (+ 2016us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:46.419003 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:46.419009 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:46.419022 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:46.419288 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:46.419587 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:46.419590 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:46.419592 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:46.419741 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:46.420142 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:46.420149 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:46.420392 (+ 243us) client_negotiation.cc:769] Sending connection context
0809 02:25:46.420582 (+ 190us) client_negotiation.cc:240] Negotiation successful
0809 02:25:46.420899 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":110,"threads_started":1}
I20260809 02:25:46.422966 26527 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40355
I20260809 02:25:46.423255 26527 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:46.423883 26527 heartbeater.cc:511] Master 127.21.214.190:40355 requested a full tablet report, sending...
I20260809 02:25:46.425534 26238 ts_manager.cc:194] Registered new tserver with Master: 04279e6cbdee4a88b978f8ce9c15a61a (127.21.214.129:36249)
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:25:46.426891 26238 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:35727
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:25:46.446353 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40355
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:46.560598 26533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:46.560837 26533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:46.560909 26533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:46.564909 26533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:46.564962 26533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:46.565017 26533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:25:46.570282 26533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:46.571336 26533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:46.572431 26533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:46.582106 26543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:46.582120 26545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:46.582114 26542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:46.582459 26533 server_base.cc:1034] running on GCE node
I20260809 02:25:46.582875 26533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:46.583546 26533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:46.584738 26533 hybrid_clock.cc:648] HybridClock initialized: now 1786242346584706 us; error 44 us; skew 500 ppm
Aug 09 02:25:46 dist-test-slave-68xk krb5kdc[26148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242346, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:46.587761 26533 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:25:46.588608 26533 webserver.cc:460] Webserver started at http://127.21.214.130:44735/ using document root <none> and password file <none>
I20260809 02:25:46.589172 26533 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:46.589295 26533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:46.589529 26533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:46.591640 26533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "1e12e85341e0444b8eb2f2588ca310f5"
format_stamp: "Formatted at 2026-08-09 02:25:46 on dist-test-slave-68xk"
server_key: "e276a522deea8cef9f280701e6224e33"
server_key_iv: "b45e670f2bf458586409285df5e89f71"
server_key_version: "encryptionkey@0"
I20260809 02:25:46.592324 26533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "1e12e85341e0444b8eb2f2588ca310f5"
format_stamp: "Formatted at 2026-08-09 02:25:46 on dist-test-slave-68xk"
server_key: "e276a522deea8cef9f280701e6224e33"
server_key_iv: "b45e670f2bf458586409285df5e89f71"
server_key_version: "encryptionkey@0"
I20260809 02:25:46.596117 26533 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 02:25:46.598637 26555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:46.599853 26533 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:46.599977 26533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "1e12e85341e0444b8eb2f2588ca310f5"
format_stamp: "Formatted at 2026-08-09 02:25:46 on dist-test-slave-68xk"
server_key: "e276a522deea8cef9f280701e6224e33"
server_key_iv: "b45e670f2bf458586409285df5e89f71"
server_key_version: "encryptionkey@0"
I20260809 02:25:46.600085 26533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:46.626230 26533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:46.629752 26533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:46.629990 26533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:46.630712 26533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:46.631681 26533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:46.631735 26533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:46.631811 26533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:46.631853 26533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:46.641911 26533 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:39661
I20260809 02:25:46.641997 26728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:39661 every 8 connection(s)
I20260809 02:25:46.643196 26533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
Aug 09 02:25:46 dist-test-slave-68xk krb5kdc[26148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242346, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:46.653434 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 26533
I20260809 02:25:46.653563 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:25:46.653843 22362 external_mini_cluster.cc:1428] Setting key c85c8f08f4c0a6c5b5022d2bcc086419
I20260809 02:25:46.657629 26289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:46.645235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:52903 (local address 127.21.214.190:40355)
0809 02:25:46.645386 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:46.645390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:46.646308 (+ 918us) server_negotiation.cc:407] Connection header received
0809 02:25:46.647802 (+ 1494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:46.647805 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:46.647850 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:46.647926 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:46.649237 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.649744 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.651081 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.651287 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.651362 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:46.653963 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:46.653967 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:46.653970 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:46.654002 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:46.655608 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:46.656116 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:46.656121 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:46.656123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:46.656202 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:46.656547 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:46.656551 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:46.656553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:46.656727 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:46.656841 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:46.657343 (+ 502us) server_negotiation.cc:299] Negotiation successful
0809 02:25:46.657461 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:25:46.658491 26735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:46.645632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40355 (local address 127.21.214.130:52903)
0809 02:25:46.646136 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:46.646184 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:46.647585 (+ 1401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:46.648145 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:46.648152 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:46.648548 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:46.649056 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:46.649119 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.649874 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.649877 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:46.650962 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:46.650973 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.651441 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.651445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:46.651587 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:46.652252 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:46.652268 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:46.653800 (+ 1532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:46.655731 (+ 1931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:46.655736 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:46.655751 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:46.656010 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:46.656298 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:46.656302 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:46.656304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:46.656449 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:46.656840 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:46.656847 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:46.657089 (+ 242us) client_negotiation.cc:769] Sending connection context
0809 02:25:46.657295 (+ 206us) client_negotiation.cc:240] Negotiation successful
0809 02:25:46.657608 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":114,"threads_started":1}
I20260809 02:25:46.659658 26729 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40355
I20260809 02:25:46.659927 26729 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:46.660560 26729 heartbeater.cc:511] Master 127.21.214.190:40355 requested a full tablet report, sending...
I20260809 02:25:46.661727 26238 ts_manager.cc:194] Registered new tserver with Master: 1e12e85341e0444b8eb2f2588ca310f5 (127.21.214.130:39661)
I20260809 02:25:46.662639 26238 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:52903
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:25:46.686748 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40355
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:46.798997 26738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:46.799245 26738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:46.799288 26738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:46.803275 26738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:46.803326 26738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:46.803419 26738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:25:46.809118 26738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40355
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:46.810240 26738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:46.811388 26738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:46.821394 26746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:46.821444 26750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:46.821394 26747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:46.821668 26738 server_base.cc:1034] running on GCE node
I20260809 02:25:46.822172 26738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:46.822868 26738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:46.824031 26738 hybrid_clock.cc:648] HybridClock initialized: now 1786242346823994 us; error 51 us; skew 500 ppm
Aug 09 02:25:46 dist-test-slave-68xk krb5kdc[26148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242346, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:46.826841 26738 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:25:46.827762 26738 webserver.cc:460] Webserver started at http://127.21.214.131:45703/ using document root <none> and password file <none>
I20260809 02:25:46.828328 26738 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:46.828420 26738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:46.828650 26738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:46.830739 26738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "94697695366d4078bff7803d65dfd197"
format_stamp: "Formatted at 2026-08-09 02:25:46 on dist-test-slave-68xk"
server_key: "6425bd8b71456837402380dc8bf46600"
server_key_iv: "64168db56ddf080da871814ae9ae511f"
server_key_version: "encryptionkey@0"
I20260809 02:25:46.831300 26738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "94697695366d4078bff7803d65dfd197"
format_stamp: "Formatted at 2026-08-09 02:25:46 on dist-test-slave-68xk"
server_key: "6425bd8b71456837402380dc8bf46600"
server_key_iv: "64168db56ddf080da871814ae9ae511f"
server_key_version: "encryptionkey@0"
I20260809 02:25:46.835004 26738 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:25:46.837395 26759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:46.838676 26738 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:46.838816 26738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "94697695366d4078bff7803d65dfd197"
format_stamp: "Formatted at 2026-08-09 02:25:46 on dist-test-slave-68xk"
server_key: "6425bd8b71456837402380dc8bf46600"
server_key_iv: "64168db56ddf080da871814ae9ae511f"
server_key_version: "encryptionkey@0"
I20260809 02:25:46.838925 26738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:46.855762 26738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:46.859368 26738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:46.859579 26738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:46.860188 26738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:46.861058 26738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:46.861140 26738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:46.861228 26738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:46.861279 26738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:46.872450 26738 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:36879
I20260809 02:25:46.872468 26930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:36879 every 8 connection(s)
I20260809 02:25:46.873483 26738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:25:46.883842 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 26738
I20260809 02:25:46.884009 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:25:46.884442 22362 external_mini_cluster.cc:1428] Setting key 4e0f97a15b6f421d6a09aaf6a1de4c2a
Aug 09 02:25:46 dist-test-slave-68xk krb5kdc[26148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242346, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:46.889379 26289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:46.875458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:33901 (local address 127.21.214.190:40355)
0809 02:25:46.875623 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:46.875627 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:46.876609 (+ 982us) server_negotiation.cc:407] Connection header received
0809 02:25:46.878093 (+ 1484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:46.878098 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:46.878161 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:46.878280 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:46.879654 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.880244 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.881715 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.881979 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.882128 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:46.885317 (+ 3189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:46.885321 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:46.885324 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:46.885353 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:46.887198 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:46.887756 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:46.887759 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:46.887760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:46.887841 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:46.888278 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:46.888281 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:46.888283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:46.888487 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:46.888578 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:46.889138 (+ 560us) server_negotiation.cc:299] Negotiation successful
0809 02:25:46.889250 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 02:25:46.890306 26933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:46.875833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40355 (local address 127.21.214.131:33901)
0809 02:25:46.876396 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:46.876445 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:46.877852 (+ 1407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:46.878524 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:46.878533 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:46.878933 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:46.879476 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:46.879491 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.880387 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.880391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:46.881438 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:46.881449 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:46.882167 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:46.882173 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:46.882374 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:46.883173 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:46.883192 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:46.885099 (+ 1907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:46.887318 (+ 2219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:46.887324 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:46.887338 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:46.887653 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:46.887986 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:46.887989 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:46.887990 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:46.888156 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:46.888606 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:46.888611 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:46.888861 (+ 250us) client_negotiation.cc:769] Sending connection context
0809 02:25:46.889035 (+ 174us) client_negotiation.cc:240] Negotiation successful
0809 02:25:46.889356 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":124,"threads_started":1}
I20260809 02:25:46.891538 26931 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40355
I20260809 02:25:46.891855 26931 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:46.892467 26931 heartbeater.cc:511] Master 127.21.214.190:40355 requested a full tablet report, sending...
I20260809 02:25:46.893666 26238 ts_manager.cc:194] Registered new tserver with Master: 94697695366d4078bff7803d65dfd197 (127.21.214.131:36879)
I20260809 02:25:46.894387 26238 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:33901
I20260809 02:25:46.898922 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 02:25:46.914989 26289 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:46.913287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49124 (local address 127.21.214.190:40355)
0809 02:25:46.913445 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:46.913451 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:46.913653 (+ 202us) server_negotiation.cc:407] Connection header received
0809 02:25:46.913841 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:46.913844 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:46.913886 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:46.913971 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:46.914827 (+ 856us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49124: BlockingRecv error: recv got EOF from 127.0.0.1:49124 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:25:46.916261 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 26329
I20260809 02:25:46.932310 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 26533
I20260809 02:25:46.952811 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 26738
I20260809 02:25:46.964428 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 26174
2026-08-09T02:25:46Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2384 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:47 dist-test-slave-68xk krb5kdc[26945](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:47 dist-test-slave-68xk krb5kdc[26945](info): set up 2 sockets
Aug 09 02:25:47 dist-test-slave-68xk krb5kdc[26945](info): commencing operation
krb5kdc: starting...
W20260809 02:25:48.212604 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:25:48 dist-test-slave-68xk krb5kdc[26945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:25:48.345978 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:40281
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:41165
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:40281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:48.462968 26959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:48.463276 26959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:48.463359 26959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:48.467463 26959 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:48.467545 26959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:48.467587 26959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:48.467648 26959 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:48.467686 26959 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:48.473061 26959 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41165
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:40281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:40281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:48.474119 26959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:48.475204 26959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:48.483403 26972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:48.483417 26967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:48.483769 26965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:48.484086 26959 server_base.cc:1034] running on GCE node
I20260809 02:25:48.484563 26959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:48.485611 26959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:48.486801 26959 hybrid_clock.cc:648] HybridClock initialized: now 1786242348486784 us; error 34 us; skew 500 ppm
Aug 09 02:25:48 dist-test-slave-68xk krb5kdc[26945](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242348, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:48.489645 26959 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:25:48.490530 26959 webserver.cc:460] Webserver started at http://127.21.214.190:40971/ using document root <none> and password file <none>
I20260809 02:25:48.491062 26959 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:48.491139 26959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:48.491314 26959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:48.493315 26959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "1eb55f73ddfa48efa9e6c32966ab7283"
format_stamp: "Formatted at 2026-08-09 02:25:48 on dist-test-slave-68xk"
server_key: "4599e2dc48b9cb59a928fd6260867953"
server_key_iv: "5bcfbab800c10666e56e9c84e4088795"
server_key_version: "encryptionkey@0"
I20260809 02:25:48.493824 26959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "1eb55f73ddfa48efa9e6c32966ab7283"
format_stamp: "Formatted at 2026-08-09 02:25:48 on dist-test-slave-68xk"
server_key: "4599e2dc48b9cb59a928fd6260867953"
server_key_iv: "5bcfbab800c10666e56e9c84e4088795"
server_key_version: "encryptionkey@0"
I20260809 02:25:48.497673 26959 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 02:25:48.500123 26984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:48.501341 26959 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:25:48.501444 26959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "1eb55f73ddfa48efa9e6c32966ab7283"
format_stamp: "Formatted at 2026-08-09 02:25:48 on dist-test-slave-68xk"
server_key: "4599e2dc48b9cb59a928fd6260867953"
server_key_iv: "5bcfbab800c10666e56e9c84e4088795"
server_key_version: "encryptionkey@0"
I20260809 02:25:48.501530 26959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:48.522922 26959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:48.525853 26959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:48.526013 26959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:48.532956 26959 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:40281
I20260809 02:25:48.533293 27057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:40281 every 8 connection(s)
I20260809 02:25:48.533926 26959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:48.536682 27059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:48.542140 27059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283: Bootstrap starting.
I20260809 02:25:48.542676 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 26959
I20260809 02:25:48.542819 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:48.543081 22362 external_mini_cluster.cc:1428] Setting key 6fb3c8f66293e1738302d7484aac5379
I20260809 02:25:48.544767 27059 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:48.545532 27059 log.cc:824] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:48.547655 27059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283: No bootstrap required, opened a new log
Aug 09 02:25:48 dist-test-slave-68xk krb5kdc[26945](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:48.552258 27059 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eb55f73ddfa48efa9e6c32966ab7283" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40281 } }
I20260809 02:25:48.552558 27059 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:48.552619 27059 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eb55f73ddfa48efa9e6c32966ab7283, State: Initialized, Role: FOLLOWER
I20260809 02:25:48.553090 27059 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eb55f73ddfa48efa9e6c32966ab7283" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40281 } }
I20260809 02:25:48.553246 27059 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:48.553316 27059 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:48.553426 27059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:48.554718 27059 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eb55f73ddfa48efa9e6c32966ab7283" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40281 } }
I20260809 02:25:48.555107 27059 leader_election.cc:302] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1eb55f73ddfa48efa9e6c32966ab7283; no voters:
I20260809 02:25:48.555497 27059 leader_election.cc:288] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:48.555572 27068 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:48.555804 27068 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [term 1 LEADER]: Becoming Leader. State: Replica: 1eb55f73ddfa48efa9e6c32966ab7283, State: Running, Role: LEADER
I20260809 02:25:48.556154 27068 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eb55f73ddfa48efa9e6c32966ab7283" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40281 } }
I20260809 02:25:48.556891 27059 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:48.557356 27068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1eb55f73ddfa48efa9e6c32966ab7283" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eb55f73ddfa48efa9e6c32966ab7283" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40281 } } }
I20260809 02:25:48.557475 27068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:48.557888 27069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1eb55f73ddfa48efa9e6c32966ab7283. Latest consensus state: current_term: 1 leader_uuid: "1eb55f73ddfa48efa9e6c32966ab7283" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eb55f73ddfa48efa9e6c32966ab7283" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40281 } } }
I20260809 02:25:48.558050 27069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:48.558708 27065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:48.544277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47260 (local address 127.21.214.190:40281)
0809 02:25:48.544668 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:48.544689 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:48.544724 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:25:48.545384 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:48.545401 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:48.545768 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:48.546113 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:48.547000 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:48.548005 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:48.549157 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:48.549609 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:48.549781 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:48.552923 (+ 3142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:48.552929 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:48.552953 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:48.552979 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:48.555085 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:48.555618 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:48.555624 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:48.555628 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:48.555849 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:48.556169 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:48.556171 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:48.556172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:48.556624 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:48.556853 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:48.557150 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 02:25:48.557647 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":127,"threads_started":1}
I20260809 02:25:48.562080 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260809 02:25:48.562139 27096 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:48.562237 27096 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:48.562314 27079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:48.563045 27079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:48.568500 27079 catalog_manager.cc:1347] Generated new cluster ID: 5824c70ad7554de582396a11397221f5
I20260809 02:25:48.568559 27079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:48.575490 27079 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:48.576570 27079 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:48.583631 27079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1eb55f73ddfa48efa9e6c32966ab7283: Generated new TSK 0
I20260809 02:25:48.584107 27065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:48.578237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47264 (local address 127.21.214.190:40281)
0809 02:25:48.578339 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:48.578343 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:48.578697 (+ 354us) server_negotiation.cc:407] Connection header received
0809 02:25:48.578822 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:48.578826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:48.578876 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:48.578967 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:48.579547 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:48.580379 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:48.581552 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:48.581926 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:48.582031 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:48.583036 (+ 1005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:48.583040 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:48.583043 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:48.583621 (+ 578us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:48.583654 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:48.583672 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:48.583764 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:48.583902 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 02:25:48.583963 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":39}
I20260809 02:25:48.584527 27079 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:48.593152 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 26959
2026-08-09T02:25:48Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1632 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:48 dist-test-slave-68xk krb5kdc[27114](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:48 dist-test-slave-68xk krb5kdc[27114](info): set up 2 sockets
Aug 09 02:25:48 dist-test-slave-68xk krb5kdc[27114](info): commencing operation
krb5kdc: starting...
W20260809 02:25:49.829779 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:25:49 dist-test-slave-68xk krb5kdc[27114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:25:49.967248 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:36037
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:38911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:36037
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:50.080139 27130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:50.080438 27130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:50.080514 27130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:50.084466 27130 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:50.084559 27130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:50.084597 27130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:50.084654 27130 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:50.084690 27130 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:50.089823 27130 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:38911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:36037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:36037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:50.090865 27130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:50.091893 27130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:25:50.100879 27130 server_base.cc:1034] running on GCE node
W20260809 02:25:50.100800 27146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:50.100816 27139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:50.100800 27143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:50.101693 27130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:50.102802 27130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:50.104002 27130 hybrid_clock.cc:648] HybridClock initialized: now 1786242350103980 us; error 54 us; skew 500 ppm
Aug 09 02:25:50 dist-test-slave-68xk krb5kdc[27114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242350, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:50.107092 27130 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:25:50.108049 27130 webserver.cc:460] Webserver started at http://127.21.214.190:43339/ using document root <none> and password file <none>
I20260809 02:25:50.108649 27130 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:50.108750 27130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:50.109006 27130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:50.111222 27130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "88b46f725fbc4af9ba733fd82fb5b2b1"
format_stamp: "Formatted at 2026-08-09 02:25:50 on dist-test-slave-68xk"
server_key: "79f070c2aeec836cd5aaa0b19ccd25f8"
server_key_iv: "843d0693762a14457d0bc890270a90e7"
server_key_version: "encryptionkey@0"
I20260809 02:25:50.111822 27130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "88b46f725fbc4af9ba733fd82fb5b2b1"
format_stamp: "Formatted at 2026-08-09 02:25:50 on dist-test-slave-68xk"
server_key: "79f070c2aeec836cd5aaa0b19ccd25f8"
server_key_iv: "843d0693762a14457d0bc890270a90e7"
server_key_version: "encryptionkey@0"
I20260809 02:25:50.115782 27130 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:25:50.118266 27155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:50.119542 27130 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:50.119710 27130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "88b46f725fbc4af9ba733fd82fb5b2b1"
format_stamp: "Formatted at 2026-08-09 02:25:50 on dist-test-slave-68xk"
server_key: "79f070c2aeec836cd5aaa0b19ccd25f8"
server_key_iv: "843d0693762a14457d0bc890270a90e7"
server_key_version: "encryptionkey@0"
I20260809 02:25:50.119829 27130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:50.139762 27130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:50.142674 27130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:50.142896 27130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:50.150537 27130 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:36037
I20260809 02:25:50.150884 27233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:36037 every 8 connection(s)
I20260809 02:25:50.151564 27130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:50.154045 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 27130
I20260809 02:25:50.154174 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:50.154479 27235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:50.154541 22362 external_mini_cluster.cc:1428] Setting key 53da5ae884c6a946ff808a9bb6e70fd2
I20260809 02:25:50.161424 27235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1: Bootstrap starting.
Aug 09 02:25:50 dist-test-slave-68xk krb5kdc[27114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:50.164216 27235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:50.165074 27235 log.cc:824] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:50.167531 27235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1: No bootstrap required, opened a new log
I20260809 02:25:50.170210 27238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:50.155995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59532 (local address 127.21.214.190:36037)
0809 02:25:50.156412 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:50.156429 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:50.156465 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:25:50.157261 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:50.157280 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:50.157609 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:50.157892 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:50.158868 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.159992 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.161174 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.161740 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.161875 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:50.164788 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:50.164794 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:50.164806 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:50.164832 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:50.167127 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:50.167560 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:50.167568 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:50.167575 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:50.167722 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:50.167989 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:50.167992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:50.167994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:50.168463 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:50.168648 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:50.168894 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 02:25:50.169174 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":135,"threads_started":1}
I20260809 02:25:50.171988 27235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b46f725fbc4af9ba733fd82fb5b2b1" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36037 } }
I20260809 02:25:50.172251 27235 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:50.172367 27235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88b46f725fbc4af9ba733fd82fb5b2b1, State: Initialized, Role: FOLLOWER
I20260809 02:25:50.172776 27235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b46f725fbc4af9ba733fd82fb5b2b1" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36037 } }
I20260809 02:25:50.172916 27235 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:50.172981 27235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:50.173082 27235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:50.173935 27235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b46f725fbc4af9ba733fd82fb5b2b1" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36037 } }
I20260809 02:25:50.174270 27235 leader_election.cc:302] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88b46f725fbc4af9ba733fd82fb5b2b1; no voters:
I20260809 02:25:50.174589 27235 leader_election.cc:288] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:50.174698 27241 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:50.174937 27241 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [term 1 LEADER]: Becoming Leader. State: Replica: 88b46f725fbc4af9ba733fd82fb5b2b1, State: Running, Role: LEADER
I20260809 02:25:50.175282 27241 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b46f725fbc4af9ba733fd82fb5b2b1" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36037 } }
I20260809 02:25:50.175781 27235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:50.176923 27244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88b46f725fbc4af9ba733fd82fb5b2b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b46f725fbc4af9ba733fd82fb5b2b1" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36037 } } }
I20260809 02:25:50.177121 27244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:50.177547 27245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88b46f725fbc4af9ba733fd82fb5b2b1. Latest consensus state: current_term: 1 leader_uuid: "88b46f725fbc4af9ba733fd82fb5b2b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b46f725fbc4af9ba733fd82fb5b2b1" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36037 } } }
I20260809 02:25:50.177657 27245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:50.178258 27254 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:50.181265 27254 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:50.186436 27254 catalog_manager.cc:1347] Generated new cluster ID: 29a1ac8f82e7458b85c5ba17d0dff9dc
I20260809 02:25:50.186501 27254 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:50.234615 27254 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:50.235832 27254 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:50.244931 27254 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88b46f725fbc4af9ba733fd82fb5b2b1: Generated new TSK 0
I20260809 02:25:50.245611 27254 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:25:50.283823 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:36037
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:38911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:50.396953 27270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:50.397253 27270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:50.397332 27270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:50.401324 27270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:50.401417 27270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:50.401513 27270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:25:50.406739 27270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:38911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:36037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:50.407796 27270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:50.408852 27270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:50.418704 27277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:50.418738 27270 server_base.cc:1034] running on GCE node
W20260809 02:25:50.418691 27278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:50.418745 27283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:50.419341 27270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:50.419972 27270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:50.421132 27270 hybrid_clock.cc:648] HybridClock initialized: now 1786242350421118 us; error 25 us; skew 500 ppm
Aug 09 02:25:50 dist-test-slave-68xk krb5kdc[27114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242350, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:50.424325 27270 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:25:50.425211 27270 webserver.cc:460] Webserver started at http://127.21.214.129:44721/ using document root <none> and password file <none>
I20260809 02:25:50.425784 27270 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:50.425877 27270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:50.426116 27270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:50.428239 27270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "28f3b9356388443690b3b56731783f6b"
format_stamp: "Formatted at 2026-08-09 02:25:50 on dist-test-slave-68xk"
server_key: "579b4d33d608e937b2363b1090c15119"
server_key_iv: "10905d6dc612af99facdf0d368464287"
server_key_version: "encryptionkey@0"
I20260809 02:25:50.428820 27270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "28f3b9356388443690b3b56731783f6b"
format_stamp: "Formatted at 2026-08-09 02:25:50 on dist-test-slave-68xk"
server_key: "579b4d33d608e937b2363b1090c15119"
server_key_iv: "10905d6dc612af99facdf0d368464287"
server_key_version: "encryptionkey@0"
I20260809 02:25:50.432649 27270 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:25:50.435124 27294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:50.436403 27270 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:50.436539 27270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "28f3b9356388443690b3b56731783f6b"
format_stamp: "Formatted at 2026-08-09 02:25:50 on dist-test-slave-68xk"
server_key: "579b4d33d608e937b2363b1090c15119"
server_key_iv: "10905d6dc612af99facdf0d368464287"
server_key_version: "encryptionkey@0"
I20260809 02:25:50.436648 27270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:50.459859 27270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:50.463339 27270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:50.463543 27270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:50.464102 27270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:50.464937 27270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:50.464986 27270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:50.465026 27270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:50.465061 27270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:50.473908 27270 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:46465
I20260809 02:25:50.473987 27475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:46465 every 8 connection(s)
I20260809 02:25:50.474848 27270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:25:50.481112 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 27270
I20260809 02:25:50.481254 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:25:50.481580 22362 external_mini_cluster.cc:1428] Setting key 7db16719fc22c31d981c113abaeb7b33
Aug 09 02:25:50 dist-test-slave-68xk krb5kdc[27114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242350, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:50.489694 27238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:50.476694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:39131 (local address 127.21.214.190:36037)
0809 02:25:50.476828 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:50.476837 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:50.477722 (+ 885us) server_negotiation.cc:407] Connection header received
0809 02:25:50.479102 (+ 1380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:50.479105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:50.479189 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:50.479271 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:50.480450 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.481101 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.482564 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.482823 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.482953 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:50.485907 (+ 2954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:50.485910 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:50.485919 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:50.485945 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:50.487567 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:50.488100 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:50.488105 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:50.488107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:50.488195 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:50.488552 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:50.488556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:50.488557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:50.488759 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:50.488873 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:50.489376 (+ 503us) server_negotiation.cc:299] Negotiation successful
0809 02:25:50.489514 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:25:50.490579 27480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:50.477032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36037 (local address 127.21.214.129:39131)
0809 02:25:50.477566 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:50.477608 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:50.478884 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:50.479442 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:50.479448 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:50.479823 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:50.480301 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:50.480315 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.481312 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.481315 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:50.482395 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:50.482405 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.482998 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.483002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:50.483181 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:50.483806 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:50.483823 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:50.485718 (+ 1895us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:50.487708 (+ 1990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:50.487714 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:50.487729 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:50.487990 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:50.488300 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:50.488303 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:50.488305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:50.488447 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:50.488872 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:50.488879 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:50.489127 (+ 248us) client_negotiation.cc:769] Sending connection context
0809 02:25:50.489335 (+ 208us) client_negotiation.cc:240] Negotiation successful
0809 02:25:50.489670 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":172,"threads_started":1}
I20260809 02:25:50.492002 27476 heartbeater.cc:347] Connected to a master server at 127.21.214.190:36037
I20260809 02:25:50.492264 27476 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:25:50.492807 27476 heartbeater.cc:511] Master 127.21.214.190:36037 requested a full tablet report, sending...
I20260809 02:25:50.494309 27180 ts_manager.cc:194] Registered new tserver with Master: 28f3b9356388443690b3b56731783f6b (127.21.214.129:46465)
I20260809 02:25:50.495539 27180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:39131
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:25:50.513556 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:36037
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:38911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:50.628168 27484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:50.628446 27484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:50.628518 27484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:50.632673 27484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:50.632733 27484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:50.632828 27484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:25:50.638293 27484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:38911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:36037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:50.639392 27484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:50.640501 27484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:50.650750 27494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:50.650676 27498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:50.650684 27493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:50.651024 27484 server_base.cc:1034] running on GCE node
I20260809 02:25:50.651424 27484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:50.652065 27484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:50.653283 27484 hybrid_clock.cc:648] HybridClock initialized: now 1786242350653267 us; error 28 us; skew 500 ppm
Aug 09 02:25:50 dist-test-slave-68xk krb5kdc[27114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242350, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:50.656308 27484 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:25:50.657320 27484 webserver.cc:460] Webserver started at http://127.21.214.130:34395/ using document root <none> and password file <none>
I20260809 02:25:50.657949 27484 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:50.658057 27484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:50.658331 27484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:50.660626 27484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "57cdc99c7de647c5ac66d7a54bca6362"
format_stamp: "Formatted at 2026-08-09 02:25:50 on dist-test-slave-68xk"
server_key: "f0bcedd4a4fe487f5a289eb3064fef30"
server_key_iv: "500ba23322bae62d161bbf87c9f9b12a"
server_key_version: "encryptionkey@0"
I20260809 02:25:50.661273 27484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "57cdc99c7de647c5ac66d7a54bca6362"
format_stamp: "Formatted at 2026-08-09 02:25:50 on dist-test-slave-68xk"
server_key: "f0bcedd4a4fe487f5a289eb3064fef30"
server_key_iv: "500ba23322bae62d161bbf87c9f9b12a"
server_key_version: "encryptionkey@0"
I20260809 02:25:50.665460 27484 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 02:25:50.668226 27509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:50.669449 27484 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:50.669589 27484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "57cdc99c7de647c5ac66d7a54bca6362"
format_stamp: "Formatted at 2026-08-09 02:25:50 on dist-test-slave-68xk"
server_key: "f0bcedd4a4fe487f5a289eb3064fef30"
server_key_iv: "500ba23322bae62d161bbf87c9f9b12a"
server_key_version: "encryptionkey@0"
I20260809 02:25:50.669699 27484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:50.682751 27484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:50.685511 27484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:50.685810 27484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:50.686401 27484 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:50.687269 27484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:50.687343 27484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:50.687415 27484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:50.687584 27484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:50.696991 27484 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:34171
I20260809 02:25:50.697010 27686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:34171 every 8 connection(s)
I20260809 02:25:50.698082 27484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:25:50.700701 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 27484
I20260809 02:25:50.700829 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:25:50.701151 22362 external_mini_cluster.cc:1428] Setting key da96c7fe8ed462557002b4992c65c51a
Aug 09 02:25:50 dist-test-slave-68xk krb5kdc[27114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242350, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
I20260809 02:25:50.714102 27238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:50.700220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:36531 (local address 127.21.214.190:36037)
0809 02:25:50.700356 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:50.700365 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:50.701110 (+ 745us) server_negotiation.cc:407] Connection header received
0809 02:25:50.702786 (+ 1676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:50.702789 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:50.702841 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:50.702930 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:50.704080 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.704912 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.706809 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.707035 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.707126 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:50.710376 (+ 3250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:50.710379 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:50.710381 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:50.710440 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:50.711913 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:50.712543 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:50.712545 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:50.712547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:50.712620 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:50.712985 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:50.712990 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:50.712992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:50.713180 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:50.713307 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:50.713803 (+ 496us) server_negotiation.cc:299] Negotiation successful
0809 02:25:50.713935 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:25:50.715106 27691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:50.700426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36037 (local address 127.21.214.130:36531)
0809 02:25:50.700925 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:50.700980 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:50.702554 (+ 1574us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:50.703093 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:50.703100 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:50.703451 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:50.703923 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:50.703936 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.705067 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.705073 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:50.706658 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:50.706674 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.707208 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.707215 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:50.707454 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:50.708253 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:50.708279 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:50.710192 (+ 1913us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:50.712046 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:50.712055 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:50.712073 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:50.712446 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:50.712721 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:50.712724 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:50.712726 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:50.712883 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:50.713308 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:50.713316 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:50.713563 (+ 247us) client_negotiation.cc:769] Sending connection context
0809 02:25:50.713764 (+ 201us) client_negotiation.cc:240] Negotiation successful
0809 02:25:50.714115 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":152,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
I20260809 02:25:50.716367 27687 heartbeater.cc:347] Connected to a master server at 127.21.214.190:36037
I20260809 02:25:50.716656 27687 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:50.717173 27687 heartbeater.cc:511] Master 127.21.214.190:36037 requested a full tablet report, sending...
I20260809 02:25:50.718381 27180 ts_manager.cc:194] Registered new tserver with Master: 57cdc99c7de647c5ac66d7a54bca6362 (127.21.214.130:34171)
I20260809 02:25:50.719012 27180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:36531
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:25:50.734164 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:36037
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:38911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:50.848950 27694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:50.849217 27694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:50.849295 27694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:50.853401 27694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:50.853467 27694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:50.853570 27694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:25:50.859011 27694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:38911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:36037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:50.860164 27694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:50.861200 27694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:50.870918 27705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:50.870898 27703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:50.870924 27700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:50.871243 27694 server_base.cc:1034] running on GCE node
I20260809 02:25:50.871647 27694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:50.872300 27694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:50.873476 27694 hybrid_clock.cc:648] HybridClock initialized: now 1786242350873461 us; error 30 us; skew 500 ppm
Aug 09 02:25:50 dist-test-slave-68xk krb5kdc[27114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242350, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:50.876451 27694 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:25:50.877323 27694 webserver.cc:460] Webserver started at http://127.21.214.131:43037/ using document root <none> and password file <none>
I20260809 02:25:50.877879 27694 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:50.877966 27694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:50.878177 27694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:50.880225 27694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "34abb51530e749ae992087fe43649fec"
format_stamp: "Formatted at 2026-08-09 02:25:50 on dist-test-slave-68xk"
server_key: "0c209d3c7a8a0c5afe97c290e8ce2f02"
server_key_iv: "7039318d2b881032e1c53280b75aeb71"
server_key_version: "encryptionkey@0"
I20260809 02:25:50.880813 27694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "34abb51530e749ae992087fe43649fec"
format_stamp: "Formatted at 2026-08-09 02:25:50 on dist-test-slave-68xk"
server_key: "0c209d3c7a8a0c5afe97c290e8ce2f02"
server_key_iv: "7039318d2b881032e1c53280b75aeb71"
server_key_version: "encryptionkey@0"
I20260809 02:25:50.884603 27694 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:25:50.887108 27716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:50.888329 27694 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:50.888461 27694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "34abb51530e749ae992087fe43649fec"
format_stamp: "Formatted at 2026-08-09 02:25:50 on dist-test-slave-68xk"
server_key: "0c209d3c7a8a0c5afe97c290e8ce2f02"
server_key_iv: "7039318d2b881032e1c53280b75aeb71"
server_key_version: "encryptionkey@0"
I20260809 02:25:50.888574 27694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:50.910590 27694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:50.913419 27694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:50.913615 27694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:50.914198 27694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:50.915068 27694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:50.915140 27694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:50.915212 27694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:50.915279 27694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:50.924883 27694 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:33375
I20260809 02:25:50.924969 27868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:33375 every 8 connection(s)
I20260809 02:25:50.925817 27694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:25:50.931069 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 27694
I20260809 02:25:50.931185 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:25:50.931504 22362 external_mini_cluster.cc:1428] Setting key 260ab71650a02670d4bde8bac2e40528
Aug 09 02:25:50 dist-test-slave-68xk krb5kdc[27114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242350, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:50.940083 27238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:50.927701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:44243 (local address 127.21.214.190:36037)
0809 02:25:50.927844 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:50.927847 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:50.928627 (+ 780us) server_negotiation.cc:407] Connection header received
0809 02:25:50.930029 (+ 1402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:50.930033 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:50.930093 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:50.930173 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:50.931646 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.932367 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.933821 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.934037 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.934116 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:50.936635 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:50.936638 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:50.936640 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:50.936668 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:50.938116 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:50.938654 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:50.938657 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:50.938658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:50.938733 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:50.939062 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:50.939064 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:50.939065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:50.939267 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:50.939347 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:50.939852 (+ 505us) server_negotiation.cc:299] Negotiation successful
0809 02:25:50.939951 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:25:50.940966 27871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:50.928035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36037 (local address 127.21.214.131:44243)
0809 02:25:50.928485 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:50.928527 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:50.929822 (+ 1295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:50.930342 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:50.930349 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:50.930766 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:50.931473 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:50.931493 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.932536 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.932539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:50.933688 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:50.933700 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.934158 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.934160 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:50.934313 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:50.934969 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:50.934985 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:50.936475 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:50.938232 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:50.938237 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:50.938247 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:50.938566 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:50.938836 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:50.938838 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:50.938840 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:50.938974 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:50.939364 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:50.939369 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:50.939636 (+ 267us) client_negotiation.cc:769] Sending connection context
0809 02:25:50.939801 (+ 165us) client_negotiation.cc:240] Negotiation successful
0809 02:25:50.940042 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":131,"threads_started":1}
I20260809 02:25:50.942118 27869 heartbeater.cc:347] Connected to a master server at 127.21.214.190:36037
I20260809 02:25:50.942375 27869 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:50.942889 27869 heartbeater.cc:511] Master 127.21.214.190:36037 requested a full tablet report, sending...
I20260809 02:25:50.943933 27180 ts_manager.cc:194] Registered new tserver with Master: 34abb51530e749ae992087fe43649fec (127.21.214.131:33375)
I20260809 02:25:50.944720 27180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:44243
I20260809 02:25:50.945381 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:25:50 dist-test-slave-68xk krb5kdc[27114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242350, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 02:25:50 dist-test-slave-68xk krb5kdc[27114](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242350, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:50.972613 27238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:50.964279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59540 (local address 127.21.214.190:36037)
0809 02:25:50.964415 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:50.964418 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:50.964593 (+ 175us) server_negotiation.cc:407] Connection header received
0809 02:25:50.964702 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:50.964705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:50.964749 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:50.964826 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:50.965540 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.966128 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.967011 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:50.967258 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:50.967346 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:50.969713 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:50.969716 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:50.969718 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:50.969742 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:50.971246 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:50.971590 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:50.971593 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:50.971594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:50.971671 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:50.971899 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:50.971901 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:50.971902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:50.972108 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:50.972259 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:50.972399 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 02:25:50.972491 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 02:25:50.973076 27178 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59540
I20260809 02:25:50.973955 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 27270
I20260809 02:25:50.987231 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 27484
I20260809 02:25:50.998721 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 27694
I20260809 02:25:51.010138 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 27130
2026-08-09T02:25:51Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2409 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:51 dist-test-slave-68xk krb5kdc[27886](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:51 dist-test-slave-68xk krb5kdc[27886](info): set up 2 sockets
Aug 09 02:25:51 dist-test-slave-68xk krb5kdc[27886](info): commencing operation
krb5kdc: starting...
W20260809 02:25:52.237296 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:25:52 dist-test-slave-68xk krb5kdc[27886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:25:52.367832 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:44655
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:44655
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:52.480581 27902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:52.480872 27902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:52.480942 27902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:52.484871 27902 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:52.484962 27902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:52.485000 27902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:52.485052 27902 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:52.485095 27902 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:52.490228 27902 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:44655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:44655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:52.491318 27902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:52.492341 27902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:52.501335 27909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:52.501403 27902 server_base.cc:1034] running on GCE node
W20260809 02:25:52.501353 27915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:52.501355 27913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:52.502292 27902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:52.503373 27902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:52.504536 27902 hybrid_clock.cc:648] HybridClock initialized: now 1786242352504515 us; error 30 us; skew 500 ppm
Aug 09 02:25:52 dist-test-slave-68xk krb5kdc[27886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242352, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:52.512065 27902 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:25:52.512984 27902 webserver.cc:460] Webserver started at http://127.21.214.190:35287/ using document root <none> and password file <none>
I20260809 02:25:52.513561 27902 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:52.513655 27902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:52.513895 27902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:52.516055 27902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "3308d0e462a3441c85ff8e12dd243c87"
format_stamp: "Formatted at 2026-08-09 02:25:52 on dist-test-slave-68xk"
server_key: "fa339f8b56743ce419ff145bf96e1f81"
server_key_iv: "ce8c0c17ef8d2d548d61b532ca43630b"
server_key_version: "encryptionkey@0"
I20260809 02:25:52.516638 27902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "3308d0e462a3441c85ff8e12dd243c87"
format_stamp: "Formatted at 2026-08-09 02:25:52 on dist-test-slave-68xk"
server_key: "fa339f8b56743ce419ff145bf96e1f81"
server_key_iv: "ce8c0c17ef8d2d548d61b532ca43630b"
server_key_version: "encryptionkey@0"
I20260809 02:25:52.520509 27902 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:25:52.522964 27925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:52.524266 27902 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:52.524453 27902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "3308d0e462a3441c85ff8e12dd243c87"
format_stamp: "Formatted at 2026-08-09 02:25:52 on dist-test-slave-68xk"
server_key: "fa339f8b56743ce419ff145bf96e1f81"
server_key_iv: "ce8c0c17ef8d2d548d61b532ca43630b"
server_key_version: "encryptionkey@0"
I20260809 02:25:52.524569 27902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:52.543376 27902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:52.546445 27902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:52.546665 27902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:52.554781 27902 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:44655
I20260809 02:25:52.554813 28005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:44655 every 8 connection(s)
I20260809 02:25:52.555796 27902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:52.558897 28006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:52.564720 28006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87: Bootstrap starting.
I20260809 02:25:52.565192 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 27902
I20260809 02:25:52.565325 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:52.565616 22362 external_mini_cluster.cc:1428] Setting key d019b5a17c5e16ce33d53e71d34435ab
I20260809 02:25:52.567615 28006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:52.568378 28006 log.cc:824] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:52.570567 28006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87: No bootstrap required, opened a new log
Aug 09 02:25:52 dist-test-slave-68xk krb5kdc[27886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:52.575254 28006 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3308d0e462a3441c85ff8e12dd243c87" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44655 } }
I20260809 02:25:52.575516 28006 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:52.575580 28006 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3308d0e462a3441c85ff8e12dd243c87, State: Initialized, Role: FOLLOWER
I20260809 02:25:52.576120 28006 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3308d0e462a3441c85ff8e12dd243c87" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44655 } }
I20260809 02:25:52.576334 28006 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:52.576408 28006 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:52.576525 28006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:52.577435 28006 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3308d0e462a3441c85ff8e12dd243c87" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44655 } }
I20260809 02:25:52.577780 28006 leader_election.cc:302] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3308d0e462a3441c85ff8e12dd243c87; no voters:
I20260809 02:25:52.578128 28006 leader_election.cc:288] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:52.578249 28013 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:52.578577 28013 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [term 1 LEADER]: Becoming Leader. State: Replica: 3308d0e462a3441c85ff8e12dd243c87, State: Running, Role: LEADER
I20260809 02:25:52.578945 28013 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3308d0e462a3441c85ff8e12dd243c87" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44655 } }
I20260809 02:25:52.579555 28006 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:52.580799 28016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3308d0e462a3441c85ff8e12dd243c87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3308d0e462a3441c85ff8e12dd243c87" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44655 } } }
I20260809 02:25:52.580920 28016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:52.580950 28009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:52.566996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38604 (local address 127.21.214.190:44655)
0809 02:25:52.567420 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:52.567443 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:52.567479 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:25:52.568156 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:52.568174 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:52.568549 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:52.568890 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:52.569758 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:52.570895 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:52.572022 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:52.572497 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:52.572616 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:52.575533 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:52.575550 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:52.575567 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:52.575601 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:52.577481 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:52.577950 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:52.577957 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:52.577962 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:52.578106 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:52.578477 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:52.578482 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:52.578487 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:52.579040 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:52.579279 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:52.579576 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 02:25:52.579908 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":137,"threads_started":1}
I20260809 02:25:52.581158 28016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3308d0e462a3441c85ff8e12dd243c87. Latest consensus state: current_term: 1 leader_uuid: "3308d0e462a3441c85ff8e12dd243c87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3308d0e462a3441c85ff8e12dd243c87" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44655 } } }
I20260809 02:25:52.581247 28016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87 [sys.catalog]: This master's current role is: LEADER
W20260809 02:25:52.585641 28034 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:52.585760 28034 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:52.585846 28026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:52.586743 28026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:52.592842 28026 catalog_manager.cc:1347] Generated new cluster ID: 98aa1b023898418b9658df1e98156138
I20260809 02:25:52.592921 28026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:52.609948 28026 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:52.610980 28026 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:52.617651 28026 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3308d0e462a3441c85ff8e12dd243c87: Generated new TSK 0
I20260809 02:25:52.618330 28026 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:25:52.654961 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44655
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:52.770663 28043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:52.770932 28043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:52.770982 28043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:52.775590 28043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:52.775655 28043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:52.775750 28043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:25:52.781407 28043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:52.782508 28043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:52.783571 28043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:52.793550 28054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:52.793562 28057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:52.793608 28043 server_base.cc:1034] running on GCE node
W20260809 02:25:52.793560 28051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:52.794201 28043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:52.794879 28043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:52.796080 28043 hybrid_clock.cc:648] HybridClock initialized: now 1786242352796065 us; error 27 us; skew 500 ppm
Aug 09 02:25:52 dist-test-slave-68xk krb5kdc[27886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242352, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:52.798985 28043 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:25:52.799803 28043 webserver.cc:460] Webserver started at http://127.21.214.129:44633/ using document root <none> and password file <none>
I20260809 02:25:52.800326 28043 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:52.800387 28043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:52.800554 28043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:52.802608 28043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "8bc696a4146a42da8637b7890f32f541"
format_stamp: "Formatted at 2026-08-09 02:25:52 on dist-test-slave-68xk"
server_key: "2fcb246b1a04268417bb7ce011596af5"
server_key_iv: "2abd1de312b67a5094d6b0d7c3ca752f"
server_key_version: "encryptionkey@0"
I20260809 02:25:52.803130 28043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "8bc696a4146a42da8637b7890f32f541"
format_stamp: "Formatted at 2026-08-09 02:25:52 on dist-test-slave-68xk"
server_key: "2fcb246b1a04268417bb7ce011596af5"
server_key_iv: "2abd1de312b67a5094d6b0d7c3ca752f"
server_key_version: "encryptionkey@0"
I20260809 02:25:52.806881 28043 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 02:25:52.809249 28065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:52.810556 28043 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:52.810671 28043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "8bc696a4146a42da8637b7890f32f541"
format_stamp: "Formatted at 2026-08-09 02:25:52 on dist-test-slave-68xk"
server_key: "2fcb246b1a04268417bb7ce011596af5"
server_key_iv: "2abd1de312b67a5094d6b0d7c3ca752f"
server_key_version: "encryptionkey@0"
I20260809 02:25:52.810793 28043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:52.836431 28043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:52.839810 28043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:52.840027 28043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:52.840674 28043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:52.841563 28043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:52.841614 28043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:52.841688 28043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:52.841722 28043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:52.851437 28043 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:33477
I20260809 02:25:52.851459 28235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:33477 every 8 connection(s)
I20260809 02:25:52.852391 28043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:25:52.862052 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 28043
I20260809 02:25:52.862205 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
Aug 09 02:25:52 dist-test-slave-68xk krb5kdc[27886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242352, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:52.862591 22362 external_mini_cluster.cc:1428] Setting key 05e10e41302e0cae3d9156ca3b7340df
I20260809 02:25:52.867265 28009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:52.854228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:37687 (local address 127.21.214.190:44655)
0809 02:25:52.854400 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:52.854405 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:52.855372 (+ 967us) server_negotiation.cc:407] Connection header received
0809 02:25:52.856806 (+ 1434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:52.856809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:52.856858 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:52.856950 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:52.858147 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:52.858777 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:52.859987 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:52.860217 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:52.860324 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:52.863238 (+ 2914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:52.863242 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:52.863245 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:52.863283 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:52.865032 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:52.865538 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:52.865544 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:52.865549 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:52.865659 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:52.865976 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:52.865982 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:52.865986 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:52.866239 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:52.866355 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:52.867034 (+ 679us) server_negotiation.cc:299] Negotiation successful
0809 02:25:52.867145 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 02:25:52.868373 28238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:52.854706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44655 (local address 127.21.214.129:37687)
0809 02:25:52.855214 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:52.855258 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:52.856584 (+ 1326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:52.857128 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:52.857135 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:52.857501 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:52.857989 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:52.858002 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:52.858917 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:52.858920 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:52.859867 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:52.859878 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:52.860397 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:52.860400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:52.860561 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:52.861264 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:52.861281 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:52.863018 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:52.865159 (+ 2141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:52.865164 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:52.865175 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:52.865443 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:52.865753 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:52.865756 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:52.865757 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:52.865888 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:52.866367 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:52.866375 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:52.866768 (+ 393us) client_negotiation.cc:769] Sending connection context
0809 02:25:52.866999 (+ 231us) client_negotiation.cc:240] Negotiation successful
0809 02:25:52.867369 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":116,"threads_started":1}
I20260809 02:25:52.869561 28236 heartbeater.cc:347] Connected to a master server at 127.21.214.190:44655
I20260809 02:25:52.869812 28236 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:52.870292 28236 heartbeater.cc:511] Master 127.21.214.190:44655 requested a full tablet report, sending...
I20260809 02:25:52.871783 27953 ts_manager.cc:194] Registered new tserver with Master: 8bc696a4146a42da8637b7890f32f541 (127.21.214.129:33477)
I20260809 02:25:52.872879 27953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:37687
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:25:52.894857 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44655
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:53.012955 28242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:53.013386 28242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:53.013490 28242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:53.019438 28242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:53.019527 28242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:53.019629 28242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:25:53.025360 28242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:53.026472 28242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:53.027511 28242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:25:53.037698 28242 server_base.cc:1034] running on GCE node
W20260809 02:25:53.037714 28254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:53.037663 28250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:53.037897 28252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:53.038287 28242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:53.038932 28242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:53.040091 28242 hybrid_clock.cc:648] HybridClock initialized: now 1786242353040055 us; error 49 us; skew 500 ppm
Aug 09 02:25:53 dist-test-slave-68xk krb5kdc[27886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242353, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:53.042917 28242 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:25:53.043778 28242 webserver.cc:460] Webserver started at http://127.21.214.130:38439/ using document root <none> and password file <none>
I20260809 02:25:53.044301 28242 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:53.044361 28242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:53.044526 28242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:53.046592 28242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "c819346cb8a24f528610e77c1149d98a"
format_stamp: "Formatted at 2026-08-09 02:25:53 on dist-test-slave-68xk"
server_key: "bb488e744c630bbe538b7045df0a961d"
server_key_iv: "a193973d0229fa40768b3014fcb6cd68"
server_key_version: "encryptionkey@0"
I20260809 02:25:53.047116 28242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "c819346cb8a24f528610e77c1149d98a"
format_stamp: "Formatted at 2026-08-09 02:25:53 on dist-test-slave-68xk"
server_key: "bb488e744c630bbe538b7045df0a961d"
server_key_iv: "a193973d0229fa40768b3014fcb6cd68"
server_key_version: "encryptionkey@0"
I20260809 02:25:53.050866 28242 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 02:25:53.053303 28266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:53.054777 28242 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:25:53.054888 28242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "c819346cb8a24f528610e77c1149d98a"
format_stamp: "Formatted at 2026-08-09 02:25:53 on dist-test-slave-68xk"
server_key: "bb488e744c630bbe538b7045df0a961d"
server_key_iv: "a193973d0229fa40768b3014fcb6cd68"
server_key_version: "encryptionkey@0"
I20260809 02:25:53.054983 28242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:53.074687 28242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:53.077915 28242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:53.078099 28242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:53.078780 28242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:53.079660 28242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:53.079715 28242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:53.079758 28242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:53.079777 28242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:53.090093 28242 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:41469
I20260809 02:25:53.090108 28433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:41469 every 8 connection(s)
I20260809 02:25:53.091109 28242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:25:53.095093 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 28242
I20260809 02:25:53.095221 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:25:53.095506 22362 external_mini_cluster.cc:1428] Setting key 9162a45e6649219479a15a6ff520bc37
Aug 09 02:25:53 dist-test-slave-68xk krb5kdc[27886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242353, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:53.106119 28009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:53.093000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:55957 (local address 127.21.214.190:44655)
0809 02:25:53.093142 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:53.093146 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:53.094092 (+ 946us) server_negotiation.cc:407] Connection header received
0809 02:25:53.095728 (+ 1636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:53.095732 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:53.095794 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:53.095894 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:53.097241 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:53.097763 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:53.098976 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:53.099196 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:53.099299 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:53.102023 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:53.102030 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:53.102036 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:53.102081 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:53.103884 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:53.104439 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:53.104446 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:53.104449 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:53.104548 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:53.104905 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:53.104908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:53.104911 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:53.105156 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:53.105275 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:53.105791 (+ 516us) server_negotiation.cc:299] Negotiation successful
0809 02:25:53.105929 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:25:53.106897 28437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:53.093460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44655 (local address 127.21.214.130:55957)
0809 02:25:53.093946 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:53.093989 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:53.095486 (+ 1497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:53.096067 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:53.096073 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:53.096555 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:53.097091 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:53.097104 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:53.097891 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:53.097894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:53.098850 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:53.098860 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:53.099350 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:53.099354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:53.099521 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:53.100158 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:53.100174 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:53.101851 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:53.104024 (+ 2173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:53.104029 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:53.104051 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:53.104330 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:53.104659 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:53.104661 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:53.104663 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:53.104803 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:53.105293 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:53.105298 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:53.105528 (+ 230us) client_negotiation.cc:769] Sending connection context
0809 02:25:53.105693 (+ 165us) client_negotiation.cc:240] Negotiation successful
0809 02:25:53.105944 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":133,"threads_started":1}
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
I20260809 02:25:53.108034 28435 heartbeater.cc:347] Connected to a master server at 127.21.214.190:44655
I20260809 02:25:53.108278 28435 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:53.108763 28435 heartbeater.cc:511] Master 127.21.214.190:44655 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
I20260809 02:25:53.109905 27953 ts_manager.cc:194] Registered new tserver with Master: c819346cb8a24f528610e77c1149d98a (127.21.214.130:41469)
I20260809 02:25:53.110649 27953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:55957
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:25:53.126338 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44655
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:53.249193 28443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:53.249473 28443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:53.249519 28443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:53.253702 28443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:53.253768 28443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:53.253829 28443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:25:53.259392 28443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:53.260504 28443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:53.261548 28443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:53.271900 28449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:53.272148 28443 server_base.cc:1034] running on GCE node
W20260809 02:25:53.271937 28448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:53.271967 28452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:53.272729 28443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:53.273408 28443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:53.274595 28443 hybrid_clock.cc:648] HybridClock initialized: now 1786242353274563 us; error 61 us; skew 500 ppm
Aug 09 02:25:53 dist-test-slave-68xk krb5kdc[27886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242353, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:53.277786 28443 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:25:53.278782 28443 webserver.cc:460] Webserver started at http://127.21.214.131:36377/ using document root <none> and password file <none>
I20260809 02:25:53.279425 28443 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:53.279493 28443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:53.279676 28443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:53.281973 28443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "5534a2ffbe154d3bb42484df2e58d5f4"
format_stamp: "Formatted at 2026-08-09 02:25:53 on dist-test-slave-68xk"
server_key: "57f4928143ccce76e50a41b401a1054f"
server_key_iv: "cb01550009ce298533400cbc10474fde"
server_key_version: "encryptionkey@0"
I20260809 02:25:53.282570 28443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "5534a2ffbe154d3bb42484df2e58d5f4"
format_stamp: "Formatted at 2026-08-09 02:25:53 on dist-test-slave-68xk"
server_key: "57f4928143ccce76e50a41b401a1054f"
server_key_iv: "cb01550009ce298533400cbc10474fde"
server_key_version: "encryptionkey@0"
I20260809 02:25:53.286456 28443 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 02:25:53.288962 28461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:53.290279 28443 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:53.290463 28443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "5534a2ffbe154d3bb42484df2e58d5f4"
format_stamp: "Formatted at 2026-08-09 02:25:53 on dist-test-slave-68xk"
server_key: "57f4928143ccce76e50a41b401a1054f"
server_key_iv: "cb01550009ce298533400cbc10474fde"
server_key_version: "encryptionkey@0"
I20260809 02:25:53.290588 28443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:53.307792 28443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:53.311414 28443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:53.311640 28443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:53.312309 28443 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:53.313215 28443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:53.313290 28443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:53.313367 28443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:53.313412 28443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:53.323679 28443 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:35923
I20260809 02:25:53.323727 28637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:35923 every 8 connection(s)
I20260809 02:25:53.324679 28443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:25:53.334179 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 28443
I20260809 02:25:53.334343 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:25:53.334718 22362 external_mini_cluster.cc:1428] Setting key 7ddeb8ab69e6e45ccf206b9e2b8b2f65
Aug 09 02:25:53 dist-test-slave-68xk krb5kdc[27886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242353, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:53.339797 28009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:53.326688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:35517 (local address 127.21.214.190:44655)
0809 02:25:53.326839 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:53.326842 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:53.327818 (+ 976us) server_negotiation.cc:407] Connection header received
0809 02:25:53.329505 (+ 1687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:53.329508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:53.329558 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:53.329653 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:53.331048 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:53.331620 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:53.332776 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:53.332993 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:53.333085 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:53.335998 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:53.336003 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:53.336005 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:53.336035 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:53.337683 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:53.338191 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:53.338194 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:53.338196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:53.338270 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:53.338636 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:53.338638 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:53.338639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:53.338848 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:53.338930 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:53.339543 (+ 613us) server_negotiation.cc:299] Negotiation successful
0809 02:25:53.339668 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:25:53.340631 28642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:53.327078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44655 (local address 127.21.214.131:35517)
0809 02:25:53.327597 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:53.327667 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:53.329270 (+ 1603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:53.329880 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:53.329887 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:53.330285 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:53.330884 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:53.330899 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:53.331752 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:53.331754 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:53.332653 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:53.332662 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:53.333136 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:53.333138 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:53.333293 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:53.333930 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:53.333947 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:53.335818 (+ 1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:53.337795 (+ 1977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:53.337799 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:53.337812 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:53.338108 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:53.338347 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:53.338349 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:53.338350 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:53.338552 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:53.338985 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:53.338991 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:53.339263 (+ 272us) client_negotiation.cc:769] Sending connection context
0809 02:25:53.339442 (+ 179us) client_negotiation.cc:240] Negotiation successful
0809 02:25:53.339726 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":114,"threads_started":1}
I20260809 02:25:53.341895 28638 heartbeater.cc:347] Connected to a master server at 127.21.214.190:44655
I20260809 02:25:53.342218 28638 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:53.342829 28638 heartbeater.cc:511] Master 127.21.214.190:44655 requested a full tablet report, sending...
I20260809 02:25:53.343924 27953 ts_manager.cc:194] Registered new tserver with Master: 5534a2ffbe154d3bb42484df2e58d5f4 (127.21.214.131:35923)
I20260809 02:25:53.344504 27953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:35517
I20260809 02:25:53.348869 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 02:25:53 dist-test-slave-68xk krb5kdc[27886](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:25:53 dist-test-slave-68xk krb5kdc[27886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.129@KRBTEST.COM
I20260809 02:25:53.378235 28647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:53.367942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60514 (local address 127.21.214.129:33477)
0809 02:25:53.368283 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:53.368301 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:53.368335 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:25:53.368393 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:53.368397 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:53.368598 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:53.368737 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:53.369731 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:53.370576 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:53.371541 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:53.371978 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:53.372087 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:53.374776 (+ 2689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:53.374786 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:53.374800 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:53.374826 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:53.376467 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:53.376932 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:53.376938 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:53.376939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:53.377021 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:53.377311 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:53.377313 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:53.377314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:53.377565 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:53.377729 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:53.377942 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 02:25:53.378072 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":165,"threads_started":1}
Aug 09 02:25:53 dist-test-slave-68xk krb5kdc[27886](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:53.390120 28009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:53.381286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38608 (local address 127.21.214.190:44655)
0809 02:25:53.381442 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:53.381447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:53.381537 (+ 90us) server_negotiation.cc:407] Connection header received
0809 02:25:53.381694 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:53.381698 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:53.381750 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:53.381831 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:53.382583 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:53.383123 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:53.383909 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:53.384137 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:53.384244 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:53.386950 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:53.386960 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:53.386963 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:53.386990 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:53.388366 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:53.388807 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:53.388811 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:53.388813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:53.388905 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:53.389190 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:53.389193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:53.389195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:53.389440 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:53.389586 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:53.389819 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 02:25:53.389951 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260809 02:25:53.390702 27953 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38608
I20260809 02:25:53.391399 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 28043
I20260809 02:25:53.404881 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 28242
I20260809 02:25:53.424002 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 28443
I20260809 02:25:53.435768 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 27902
2026-08-09T02:25:53Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2429 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:53 dist-test-slave-68xk krb5kdc[28655](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:53 dist-test-slave-68xk krb5kdc[28655](info): set up 2 sockets
Aug 09 02:25:53 dist-test-slave-68xk krb5kdc[28655](info): commencing operation
krb5kdc: starting...
W20260809 02:25:54.786885 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.320s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:25:54 dist-test-slave-68xk krb5kdc[28655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:25:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:25:54.919637 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:40479
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:33827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:40479
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:55.037037 28674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:55.037321 28674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:55.037402 28674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:55.041349 28674 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:55.041429 28674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:55.041467 28674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:55.041520 28674 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:55.041556 28674 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:55.046607 28674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:33827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:40479
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:40479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:55.047603 28674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:55.048592 28674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:55.056706 28686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:55.056706 28687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:55.057058 28674 server_base.cc:1034] running on GCE node
W20260809 02:25:55.056734 28690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:55.057659 28674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:55.058804 28674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:55.059975 28674 hybrid_clock.cc:648] HybridClock initialized: now 1786242355059931 us; error 53 us; skew 500 ppm
Aug 09 02:25:55 dist-test-slave-68xk krb5kdc[28655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242355, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:55.062760 28674 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:25:55.063465 28674 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:55.063530 28674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:55.063694 28674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:55.065675 28674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "c9fb0c246b3b402e9c7eed2cece97367"
format_stamp: "Formatted at 2026-08-09 02:25:55 on dist-test-slave-68xk"
server_key: "30ee28f652c089cfc8d5fac54ff84f13"
server_key_iv: "37f60f90241d681ae726ffae448c5451"
server_key_version: "encryptionkey@0"
I20260809 02:25:55.066191 28674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "c9fb0c246b3b402e9c7eed2cece97367"
format_stamp: "Formatted at 2026-08-09 02:25:55 on dist-test-slave-68xk"
server_key: "30ee28f652c089cfc8d5fac54ff84f13"
server_key_iv: "37f60f90241d681ae726ffae448c5451"
server_key_version: "encryptionkey@0"
I20260809 02:25:55.070470 28674 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 02:25:55.072856 28697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:55.074158 28674 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:55.074321 28674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "c9fb0c246b3b402e9c7eed2cece97367"
format_stamp: "Formatted at 2026-08-09 02:25:55 on dist-test-slave-68xk"
server_key: "30ee28f652c089cfc8d5fac54ff84f13"
server_key_iv: "37f60f90241d681ae726ffae448c5451"
server_key_version: "encryptionkey@0"
I20260809 02:25:55.074460 28674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:55.093189 28674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:55.096397 28674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:55.096688 28674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:55.104230 28674 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:40479
I20260809 02:25:55.104511 28774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:40479 every 8 connection(s)
I20260809 02:25:55.104938 28674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:55.106345 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 28674
I20260809 02:25:55.106525 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:55.106861 22362 external_mini_cluster.cc:1428] Setting key 1ac402dc78eaa3e5e2ffd0ef65d26539
I20260809 02:25:55.108381 28777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:55.115517 28777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367: Bootstrap starting.
Aug 09 02:25:55 dist-test-slave-68xk krb5kdc[28655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242354, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:55.117962 28777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:55.118804 28777 log.cc:824] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:55.121165 28777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367: No bootstrap required, opened a new log
I20260809 02:25:55.122097 28780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.108446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43696 (local address 127.21.214.190:40479)
0809 02:25:55.108878 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:55.108893 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:55.108929 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:25:55.109574 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:55.109590 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:55.109919 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:55.110194 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:55.111227 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.112198 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.113485 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.113944 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.114060 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.117026 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:55.117031 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:55.117079 (+ 48us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:55.117107 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:55.118871 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:55.119410 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:55.119415 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:55.119420 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:55.119535 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:55.119856 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:55.119859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:55.119861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:55.120371 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:55.120576 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:55.120799 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 02:25:55.121108 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":140,"threads_started":1}
I20260809 02:25:55.125161 28777 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9fb0c246b3b402e9c7eed2cece97367" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40479 } }
I20260809 02:25:55.125380 28777 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:55.125458 28777 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9fb0c246b3b402e9c7eed2cece97367, State: Initialized, Role: FOLLOWER
I20260809 02:25:55.125917 28777 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9fb0c246b3b402e9c7eed2cece97367" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40479 } }
I20260809 02:25:55.126082 28777 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:55.126161 28777 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:55.126281 28777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:55.127303 28777 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9fb0c246b3b402e9c7eed2cece97367" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40479 } }
I20260809 02:25:55.127657 28777 leader_election.cc:302] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9fb0c246b3b402e9c7eed2cece97367; no voters:
I20260809 02:25:55.127990 28777 leader_election.cc:288] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:55.128078 28785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:55.128363 28785 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [term 1 LEADER]: Becoming Leader. State: Replica: c9fb0c246b3b402e9c7eed2cece97367, State: Running, Role: LEADER
I20260809 02:25:55.128683 28785 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9fb0c246b3b402e9c7eed2cece97367" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40479 } }
I20260809 02:25:55.129216 28777 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:55.130527 28786 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9fb0c246b3b402e9c7eed2cece97367" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9fb0c246b3b402e9c7eed2cece97367" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40479 } } }
I20260809 02:25:55.130683 28786 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:55.130975 28791 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9fb0c246b3b402e9c7eed2cece97367. Latest consensus state: current_term: 1 leader_uuid: "c9fb0c246b3b402e9c7eed2cece97367" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9fb0c246b3b402e9c7eed2cece97367" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40479 } } }
I20260809 02:25:55.131071 28791 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367 [sys.catalog]: This master's current role is: LEADER
W20260809 02:25:55.134213 28810 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:55.134289 28810 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:55.134377 28802 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:55.135329 28802 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:55.141036 28802 catalog_manager.cc:1347] Generated new cluster ID: 24571d388fcf4553b3341425027aee81
I20260809 02:25:55.141233 28802 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:55.154376 28802 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:55.155390 28802 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:55.163806 28802 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367: Generated new TSK 0
I20260809 02:25:55.164474 28802 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:25:55.197876 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40479
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:33827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:55.315217 28816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:55.315464 28816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:55.315508 28816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:55.319434 28816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:55.319481 28816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:55.319538 28816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:25:55.324846 28816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:33827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:55.325843 28816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:55.326833 28816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:55.336597 28824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:55.336603 28825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:55.336627 28828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:55.337067 28816 server_base.cc:1034] running on GCE node
I20260809 02:25:55.337563 28816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:55.338186 28816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:55.339416 28816 hybrid_clock.cc:648] HybridClock initialized: now 1786242355339401 us; error 35 us; skew 500 ppm
Aug 09 02:25:55 dist-test-slave-68xk krb5kdc[28655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242355, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:55.342329 28816 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:25:55.343067 28816 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:55.343134 28816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:55.343302 28816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:55.345279 28816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "14817bbaaa6e4ee0af55bb30e6494063"
format_stamp: "Formatted at 2026-08-09 02:25:55 on dist-test-slave-68xk"
server_key: "edaf5bf648a23741f4870754d106cf03"
server_key_iv: "144ca1a1d23930784417612c2b23726e"
server_key_version: "encryptionkey@0"
I20260809 02:25:55.345809 28816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "14817bbaaa6e4ee0af55bb30e6494063"
format_stamp: "Formatted at 2026-08-09 02:25:55 on dist-test-slave-68xk"
server_key: "edaf5bf648a23741f4870754d106cf03"
server_key_iv: "144ca1a1d23930784417612c2b23726e"
server_key_version: "encryptionkey@0"
I20260809 02:25:55.349464 28816 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:25:55.351936 28841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:55.353247 28816 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:25:55.353365 28816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "14817bbaaa6e4ee0af55bb30e6494063"
format_stamp: "Formatted at 2026-08-09 02:25:55 on dist-test-slave-68xk"
server_key: "edaf5bf648a23741f4870754d106cf03"
server_key_iv: "144ca1a1d23930784417612c2b23726e"
server_key_version: "encryptionkey@0"
I20260809 02:25:55.353457 28816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:55.377507 28816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:55.381270 28816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:55.381440 28816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:55.382030 28816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:55.383100 28816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:55.383174 28816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:55.383240 28816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:55.383275 28816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:55.393610 28816 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:39719
I20260809 02:25:55.393640 29006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:39719 every 8 connection(s)
I20260809 02:25:55.394284 28816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:25:55.394881 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 28816
I20260809 02:25:55.395013 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:25:55.395331 22362 external_mini_cluster.cc:1428] Setting key c78571dc62881d6bdead2d7efb2ce529
Aug 09 02:25:55 dist-test-slave-68xk krb5kdc[28655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242355, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
I20260809 02:25:55.410070 28780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.396227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:33633 (local address 127.21.214.190:40479)
0809 02:25:55.396376 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:55.396381 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:55.397797 (+ 1416us) server_negotiation.cc:407] Connection header received
0809 02:25:55.398697 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:55.398704 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:55.398774 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:55.398878 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:55.400607 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.401197 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.403120 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.403357 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.403451 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.406467 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:55.406471 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:55.406473 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:55.406498 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:55.407961 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:55.408499 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:55.408504 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:55.408505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:55.408587 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:55.408935 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:55.408940 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:55.408942 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:55.409127 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:55.409241 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:55.409761 (+ 520us) server_negotiation.cc:299] Negotiation successful
0809 02:25:55.409894 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:25:55.410960 29010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.396701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40479 (local address 127.21.214.129:33633)
0809 02:25:55.397625 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:55.397680 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:55.398492 (+ 812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:55.399093 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:55.399106 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:55.399698 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:55.400424 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:55.400448 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.401336 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.401343 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:55.402972 (+ 1629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:55.402987 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.403531 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.403538 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:55.403795 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.404497 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:55.404521 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:55.406273 (+ 1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:55.408091 (+ 1818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:55.408097 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:55.408112 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:55.408389 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:55.408686 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:55.408689 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:55.408692 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:55.408837 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:55.409242 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:55.409252 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:55.409496 (+ 244us) client_negotiation.cc:769] Sending connection context
0809 02:25:55.409717 (+ 221us) client_negotiation.cc:240] Negotiation successful
0809 02:25:55.410042 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":137,"threads_started":1}
I20260809 02:25:55.412317 29008 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40479
I20260809 02:25:55.412555 29008 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:55.413130 29008 heartbeater.cc:511] Master 127.21.214.190:40479 requested a full tablet report, sending...
I20260809 02:25:55.415027 28722 ts_manager.cc:194] Registered new tserver with Master: 14817bbaaa6e4ee0af55bb30e6494063 (127.21.214.129:39719)
I20260809 02:25:55.416798 28722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:33633
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:25:55.427449 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40479
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:33827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:55.540256 29013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:55.540488 29013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:55.540532 29013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:55.544451 29013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:55.544502 29013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:55.544603 29013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:25:55.549701 29013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:33827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:55.550719 29013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:55.552105 29013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:55.561549 29022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:55.561648 29020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:55.561583 29025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:55.561869 29013 server_base.cc:1034] running on GCE node
I20260809 02:25:55.562332 29013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:55.562983 29013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:55.564149 29013 hybrid_clock.cc:648] HybridClock initialized: now 1786242355564116 us; error 47 us; skew 500 ppm
Aug 09 02:25:55 dist-test-slave-68xk krb5kdc[28655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242355, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:55.567227 29013 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:25:55.568136 29013 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:55.568217 29013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:55.568449 29013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:55.570772 29013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "ffe5259ebd124166b43c2c506cf4315f"
format_stamp: "Formatted at 2026-08-09 02:25:55 on dist-test-slave-68xk"
server_key: "0e345c8302a0957087a11828ace0fa4f"
server_key_iv: "a61acdbf810a1e5f4146fbdce8fd55a6"
server_key_version: "encryptionkey@0"
I20260809 02:25:55.571385 29013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "ffe5259ebd124166b43c2c506cf4315f"
format_stamp: "Formatted at 2026-08-09 02:25:55 on dist-test-slave-68xk"
server_key: "0e345c8302a0957087a11828ace0fa4f"
server_key_iv: "a61acdbf810a1e5f4146fbdce8fd55a6"
server_key_version: "encryptionkey@0"
I20260809 02:25:55.575531 29013 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260809 02:25:55.578181 29035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:55.579622 29013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:25:55.579736 29013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "ffe5259ebd124166b43c2c506cf4315f"
format_stamp: "Formatted at 2026-08-09 02:25:55 on dist-test-slave-68xk"
server_key: "0e345c8302a0957087a11828ace0fa4f"
server_key_iv: "a61acdbf810a1e5f4146fbdce8fd55a6"
server_key_version: "encryptionkey@0"
I20260809 02:25:55.579828 29013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:55.607009 29013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:55.610026 29013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:55.610195 29013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:55.610816 29013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:55.611611 29013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:55.611660 29013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:55.611701 29013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:55.611716 29013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:55.620922 29013 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:44185
I20260809 02:25:55.620965 29210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:44185 every 8 connection(s)
I20260809 02:25:55.621511 29013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:25:55.624994 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 29013
I20260809 02:25:55.625120 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:25:55.625479 22362 external_mini_cluster.cc:1428] Setting key 241e76a9288abf5aad8b320286cad065
Aug 09 02:25:55 dist-test-slave-68xk krb5kdc[28655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242355, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
I20260809 02:25:55.637154 28780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.623290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:35701 (local address 127.21.214.190:40479)
0809 02:25:55.623437 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:55.623442 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:55.624631 (+ 1189us) server_negotiation.cc:407] Connection header received
0809 02:25:55.625839 (+ 1208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:55.625842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:55.625916 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:55.626010 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:55.627599 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.628115 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.629896 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.630171 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.630295 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.633282 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:55.633286 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:55.633288 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:55.633314 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:55.634923 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:55.635503 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:55.635506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:55.635508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:55.635593 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:55.635993 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:55.635997 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:55.635999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:55.636259 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:55.636356 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:55.636862 (+ 506us) server_negotiation.cc:299] Negotiation successful
0809 02:25:55.637031 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:25:55.638242 29214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.623706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40479 (local address 127.21.214.130:35701)
0809 02:25:55.624491 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:55.624533 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:55.625618 (+ 1085us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:55.626266 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:55.626279 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:55.626752 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:55.627443 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:55.627465 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.628246 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.628252 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:55.629732 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:55.629743 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.630378 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.630383 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:55.630625 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.631298 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:55.631327 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:55.633092 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:55.635056 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:55.635062 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:55.635079 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:55.635370 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:55.635699 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:55.635704 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:55.635706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:55.635860 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:55.636379 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:55.636385 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:55.636638 (+ 253us) client_negotiation.cc:769] Sending connection context
0809 02:25:55.636816 (+ 178us) client_negotiation.cc:240] Negotiation successful
0809 02:25:55.637225 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":102,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
I20260809 02:25:55.639551 29211 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40479
I20260809 02:25:55.639842 29211 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:55.640440 29211 heartbeater.cc:511] Master 127.21.214.190:40479 requested a full tablet report, sending...
I20260809 02:25:55.641702 28722 ts_manager.cc:194] Registered new tserver with Master: ffe5259ebd124166b43c2c506cf4315f (127.21.214.130:44185)
I20260809 02:25:55.642336 28722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:35701
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:25:55.655323 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40479
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:33827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:25:55.766798 29218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:55.767076 29218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:55.767149 29218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:55.771219 29218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:55.771306 29218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:55.771404 29218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:25:55.776594 29218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:33827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40479
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:55.777614 29218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:55.778717 29218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:55.788406 29234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:55.788406 29230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:55.788446 29227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:55.788748 29218 server_base.cc:1034] running on GCE node
I20260809 02:25:55.789319 29218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:55.789893 29218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:55.791072 29218 hybrid_clock.cc:648] HybridClock initialized: now 1786242355791054 us; error 30 us; skew 500 ppm
Aug 09 02:25:55 dist-test-slave-68xk krb5kdc[28655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242355, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:25:55.793932 29218 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:25:55.794768 29218 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:55.794860 29218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:55.795086 29218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:55.797077 29218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "d32f7cba9853481cbfb04e3e668a9505"
format_stamp: "Formatted at 2026-08-09 02:25:55 on dist-test-slave-68xk"
server_key: "0037a09d67f29b6b563d99455f5df385"
server_key_iv: "d31467eda18bdb353606b4dbd91259e1"
server_key_version: "encryptionkey@0"
I20260809 02:25:55.797668 29218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "d32f7cba9853481cbfb04e3e668a9505"
format_stamp: "Formatted at 2026-08-09 02:25:55 on dist-test-slave-68xk"
server_key: "0037a09d67f29b6b563d99455f5df385"
server_key_iv: "d31467eda18bdb353606b4dbd91259e1"
server_key_version: "encryptionkey@0"
I20260809 02:25:55.801364 29218 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:25:55.803838 29243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:55.805028 29218 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:25:55.805173 29218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "d32f7cba9853481cbfb04e3e668a9505"
format_stamp: "Formatted at 2026-08-09 02:25:55 on dist-test-slave-68xk"
server_key: "0037a09d67f29b6b563d99455f5df385"
server_key_iv: "d31467eda18bdb353606b4dbd91259e1"
server_key_version: "encryptionkey@0"
I20260809 02:25:55.805300 29218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:55.820254 29218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:55.823875 29218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:55.824075 29218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:55.824685 29218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:55.825515 29218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:55.825582 29218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:55.825649 29218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:55.825695 29218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:55.836367 29218 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:46023
I20260809 02:25:55.836400 29403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:46023 every 8 connection(s)
I20260809 02:25:55.837018 29218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:25:55.841922 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 29218
I20260809 02:25:55.842073 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:25:55.842486 22362 external_mini_cluster.cc:1428] Setting key 2a1d8ab74dd8b1417c17b36f7577d9af
Aug 09 02:25:55 dist-test-slave-68xk krb5kdc[28655](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242355, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:25:55.852336 28780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.839038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:34791 (local address 127.21.214.190:40479)
0809 02:25:55.839252 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:55.839256 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:55.840479 (+ 1223us) server_negotiation.cc:407] Connection header received
0809 02:25:55.841498 (+ 1019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:55.841502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:55.841552 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:55.841640 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:55.843513 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.844224 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.845667 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.845892 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.845975 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.848667 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:55.848670 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:55.848672 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:55.848695 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:55.850178 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:55.850814 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:55.850820 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:55.850825 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:55.850917 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:55.851248 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:55.851251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:55.851252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:55.851455 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:55.851534 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:55.852061 (+ 527us) server_negotiation.cc:299] Negotiation successful
0809 02:25:55.852193 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260809 02:25:55.853091 29407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.839391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40479 (local address 127.21.214.131:34791)
0809 02:25:55.840321 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:55.840369 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:55.841248 (+ 879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:55.841904 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:55.841916 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:55.842595 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:55.843325 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:55.843373 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.844370 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.844373 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:55.845548 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:55.845560 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.846039 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.846042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:55.846240 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.846855 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:25:55.846873 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:55.848479 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:55.850297 (+ 1818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:55.850302 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:55.850314 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:55.850689 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:55.851005 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:25:55.851007 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:25:55.851008 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:25:55.851144 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:25:55.851562 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:55.851569 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:55.851798 (+ 229us) client_negotiation.cc:769] Sending connection context
0809 02:25:55.851951 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 02:25:55.852237 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":122,"threads_started":1}
I20260809 02:25:55.854266 29404 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40479
I20260809 02:25:55.854528 29404 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:55.855016 29404 heartbeater.cc:511] Master 127.21.214.190:40479 requested a full tablet report, sending...
I20260809 02:25:55.856195 28722 ts_manager.cc:194] Registered new tserver with Master: d32f7cba9853481cbfb04e3e668a9505 (127.21.214.131:46023)
I20260809 02:25:55.856621 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:25:55.856830 28722 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:34791
I20260809 02:25:55.865870 28780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.858886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43704 (local address 127.21.214.190:40479)
0809 02:25:55.859039 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:55.859044 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:55.859263 (+ 219us) server_negotiation.cc:407] Connection header received
0809 02:25:55.859344 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:55.859346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:55.859386 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:55.859458 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:55.860159 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.860674 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.861504 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.861752 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.861843 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.863167 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:55.863171 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:55.863173 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:25:55.863200 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:55.864415 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:55.864832 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:55.864834 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:55.864835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:55.864905 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:25:55.865139 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:25:55.865141 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:25:55.865142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:25:55.865352 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:55.865453 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:55.865639 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 02:25:55.865736 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 02:25:55.868594 28722 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43704:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:25:55.871632 28722 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:25:55.886806 29425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.880115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:39719 (local address 127.0.0.1:53426)
0809 02:25:55.880908 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:55.880959 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:55.881093 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:55.881985 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:55.881988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:55.882006 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:55.882153 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:55.882164 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.883807 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.883811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:55.885137 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:55.885148 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.886173 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.886177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:55.886284 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.886328 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 02:25:55.886503 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 02:25:55.886631 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"mutex_wait_us":4,"thread_start_us":134,"threads_started":1}
I20260809 02:25:55.887408 29426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.880385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:44185 (local address 127.0.0.1:40622)
0809 02:25:55.881261 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:55.881279 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:55.881346 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:55.881916 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:55.881923 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:55.881944 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:55.882168 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:55.882174 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.884298 (+ 2124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.884304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:55.885603 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:55.885616 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.886782 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.886785 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:55.886886 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.886913 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 02:25:55.886990 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:25:55.887057 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":816,"mutex_wait_us":29,"thread_start_us":104,"threads_started":1}
I20260809 02:25:55.887596 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.880188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41374 (local address 127.21.214.131:46023)
0809 02:25:55.882334 (+ 2146us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:55.882345 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:55.882365 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:25:55.882473 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:55.882478 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:55.882623 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:55.882737 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:55.883024 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.884207 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.885744 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.886674 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.886813 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.886951 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:55.887304 (+ 353us) server_negotiation.cc:299] Negotiation successful
0809 02:25:55.887416 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2033,"thread_start_us":116,"threads_started":1}
I20260809 02:25:55.887738 29430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.880911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53426 (local address 127.21.214.129:39719)
0809 02:25:55.881593 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:55.881598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:55.881617 (+ 19us) server_negotiation.cc:407] Connection header received
0809 02:25:55.881678 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:55.881681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:55.881822 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:55.881997 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:55.882341 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.883645 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.885276 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.886041 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.886178 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.886320 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:55.886539 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 02:25:55.886665 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":71,"threads_started":1}
I20260809 02:25:55.887562 29428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.880052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:46023 (local address 127.0.0.1:41374)
0809 02:25:55.880751 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:55.881417 (+ 666us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:55.881509 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:55.882766 (+ 1257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:55.882769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:55.882790 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:55.882887 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:55.882894 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.884353 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.884356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:55.885615 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:55.885622 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.887032 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.887037 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:55.887147 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.887180 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 02:25:55.887267 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 02:25:55.887349 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"mutex_wait_us":70,"thread_start_us":87,"threads_started":1}
I20260809 02:25:55.888245 29431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:55.880891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40622 (local address 127.21.214.130:44185)
0809 02:25:55.881422 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:55.881440 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:55.881465 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:25:55.881545 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:55.881553 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:55.881755 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:55.881925 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:55.882890 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.884115 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.885781 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:55.886492 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:55.886602 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:55.886719 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:55.887977 (+ 1258us) server_negotiation.cc:299] Negotiation successful
0809 02:25:55.888082 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":123,"threads_started":1}
I20260809 02:25:55.890837 29104 tablet_service.cc:1467] Processing CreateTablet for tablet b59332c894f24411857a76a6819f0076 (DEFAULT_TABLE table=test-table [id=83db79d48d894a9da6f651645b597e41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:55.891000 29313 tablet_service.cc:1467] Processing CreateTablet for tablet b59332c894f24411857a76a6819f0076 (DEFAULT_TABLE table=test-table [id=83db79d48d894a9da6f651645b597e41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:55.890985 28907 tablet_service.cc:1467] Processing CreateTablet for tablet b59332c894f24411857a76a6819f0076 (DEFAULT_TABLE table=test-table [id=83db79d48d894a9da6f651645b597e41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:55.891992 29104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b59332c894f24411857a76a6819f0076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:55.892129 28907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b59332c894f24411857a76a6819f0076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:55.892153 29313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b59332c894f24411857a76a6819f0076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:55.898432 29432 tablet_bootstrap.cc:492] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f: Bootstrap starting.
I20260809 02:25:55.900389 29433 tablet_bootstrap.cc:492] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063: Bootstrap starting.
I20260809 02:25:55.900787 29432 tablet_bootstrap.cc:654] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:55.901795 29432 log.cc:824] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:55.902540 29433 tablet_bootstrap.cc:654] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:55.902650 29434 tablet_bootstrap.cc:492] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505: Bootstrap starting.
I20260809 02:25:55.903743 29433 log.cc:824] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:55.904404 29434 tablet_bootstrap.cc:654] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:55.905361 29434 log.cc:824] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:55.905826 29433 tablet_bootstrap.cc:492] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063: No bootstrap required, opened a new log
I20260809 02:25:55.906065 29433 ts_tablet_manager.cc:1397] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260809 02:25:55.906905 29432 tablet_bootstrap.cc:492] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f: No bootstrap required, opened a new log
I20260809 02:25:55.907104 29432 ts_tablet_manager.cc:1397] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260809 02:25:55.907410 29434 tablet_bootstrap.cc:492] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505: No bootstrap required, opened a new log
I20260809 02:25:55.907601 29434 ts_tablet_manager.cc:1397] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:25:55.910630 29432 raft_consensus.cc:348] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d32f7cba9853481cbfb04e3e668a9505" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46023 } } peers { permanent_uuid: "14817bbaaa6e4ee0af55bb30e6494063" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39719 } } peers { permanent_uuid: "ffe5259ebd124166b43c2c506cf4315f" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44185 } }
I20260809 02:25:55.910666 29433 raft_consensus.cc:348] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d32f7cba9853481cbfb04e3e668a9505" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46023 } } peers { permanent_uuid: "14817bbaaa6e4ee0af55bb30e6494063" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39719 } } peers { permanent_uuid: "ffe5259ebd124166b43c2c506cf4315f" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44185 } }
I20260809 02:25:55.910890 29432 raft_consensus.cc:374] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:55.910956 29433 raft_consensus.cc:374] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:55.910967 29432 raft_consensus.cc:729] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffe5259ebd124166b43c2c506cf4315f, State: Initialized, Role: FOLLOWER
I20260809 02:25:55.911046 29433 raft_consensus.cc:729] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14817bbaaa6e4ee0af55bb30e6494063, State: Initialized, Role: FOLLOWER
I20260809 02:25:55.911482 29432 consensus_queue.cc:260] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d32f7cba9853481cbfb04e3e668a9505" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46023 } } peers { permanent_uuid: "14817bbaaa6e4ee0af55bb30e6494063" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39719 } } peers { permanent_uuid: "ffe5259ebd124166b43c2c506cf4315f" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44185 } }
I20260809 02:25:55.911612 29433 consensus_queue.cc:260] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d32f7cba9853481cbfb04e3e668a9505" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46023 } } peers { permanent_uuid: "14817bbaaa6e4ee0af55bb30e6494063" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39719 } } peers { permanent_uuid: "ffe5259ebd124166b43c2c506cf4315f" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44185 } }
I20260809 02:25:55.911810 29434 raft_consensus.cc:348] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d32f7cba9853481cbfb04e3e668a9505" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46023 } } peers { permanent_uuid: "14817bbaaa6e4ee0af55bb30e6494063" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39719 } } peers { permanent_uuid: "ffe5259ebd124166b43c2c506cf4315f" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44185 } }
I20260809 02:25:55.912289 29008 heartbeater.cc:503] Master 127.21.214.190:40479 was elected leader, sending a full tablet report...
I20260809 02:25:55.912510 29432 ts_tablet_manager.cc:1428] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:25:55.912676 29433 ts_tablet_manager.cc:1428] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260809 02:25:55.912915 29211 heartbeater.cc:503] Master 127.21.214.190:40479 was elected leader, sending a full tablet report...
I20260809 02:25:55.913427 29434 raft_consensus.cc:374] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:55.913509 29434 raft_consensus.cc:729] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d32f7cba9853481cbfb04e3e668a9505, State: Initialized, Role: FOLLOWER
I20260809 02:25:55.914211 29434 consensus_queue.cc:260] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d32f7cba9853481cbfb04e3e668a9505" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46023 } } peers { permanent_uuid: "14817bbaaa6e4ee0af55bb30e6494063" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39719 } } peers { permanent_uuid: "ffe5259ebd124166b43c2c506cf4315f" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44185 } }
I20260809 02:25:55.914915 29404 heartbeater.cc:503] Master 127.21.214.190:40479 was elected leader, sending a full tablet report...
I20260809 02:25:55.915292 29434 ts_tablet_manager.cc:1428] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260809 02:25:56.055867 29443 raft_consensus.cc:482] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:25:56.056120 29443 raft_consensus.cc:504] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d32f7cba9853481cbfb04e3e668a9505" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46023 } } peers { permanent_uuid: "14817bbaaa6e4ee0af55bb30e6494063" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39719 } } peers { permanent_uuid: "ffe5259ebd124166b43c2c506cf4315f" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44185 } }
I20260809 02:25:56.057583 29443 leader_election.cc:288] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14817bbaaa6e4ee0af55bb30e6494063 (127.21.214.129:39719), ffe5259ebd124166b43c2c506cf4315f (127.21.214.130:44185)
I20260809 02:25:56.062748 29407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:56.057874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:39719 (local address 127.21.214.131:44749)
0809 02:25:56.058071 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:56.058088 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:56.058198 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:56.058570 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:56.058575 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:56.058598 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:56.058742 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:56.058753 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:56.059895 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:56.059898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:56.061242 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:56.061253 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:56.062225 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:56.062228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:56.062363 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:56.062393 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 02:25:56.062509 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 02:25:56.062597 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101}
I20260809 02:25:56.062775 29430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:56.057941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:44749 (local address 127.21.214.129:39719)
0809 02:25:56.058111 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:56.058119 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:56.058141 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:25:56.058336 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:56.058339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:56.058436 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:56.058542 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:56.058882 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:56.059750 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:56.061384 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:56.062053 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:56.062196 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:56.062261 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:56.062523 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 02:25:56.062642 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 02:25:56.062804 29431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:56.058048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:40993 (local address 127.21.214.130:44185)
0809 02:25:56.058208 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:56.058212 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:56.058793 (+ 581us) server_negotiation.cc:407] Connection header received
0809 02:25:56.058900 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:56.058903 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:56.058957 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:56.059046 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:25:56.059309 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:56.060040 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:56.061504 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:56.062218 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:56.062344 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:56.062380 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:56.062614 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 02:25:56.062685 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:25:56.062760 29444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:56.057880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:44185 (local address 127.21.214.131:40993)
0809 02:25:56.058688 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:56.058706 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:56.058810 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:56.059054 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:56.059056 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:56.059070 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:25:56.059199 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:56.059204 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:56.060186 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:56.060192 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:56.061395 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:56.061403 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:56.062341 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:56.062344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:56.062477 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:56.062509 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 02:25:56.062576 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:25:56.062626 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"mutex_wait_us":340,"thread_start_us":181,"threads_started":1}
I20260809 02:25:56.063599 29142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b59332c894f24411857a76a6819f0076" candidate_uuid: "d32f7cba9853481cbfb04e3e668a9505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffe5259ebd124166b43c2c506cf4315f" is_pre_election: true
I20260809 02:25:56.063599 28939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b59332c894f24411857a76a6819f0076" candidate_uuid: "d32f7cba9853481cbfb04e3e668a9505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14817bbaaa6e4ee0af55bb30e6494063" is_pre_election: true
I20260809 02:25:56.063920 29142 raft_consensus.cc:2454] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d32f7cba9853481cbfb04e3e668a9505 in term 0.
I20260809 02:25:56.063920 28939 raft_consensus.cc:2454] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d32f7cba9853481cbfb04e3e668a9505 in term 0.
I20260809 02:25:56.064459 29247 leader_election.cc:302] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 14817bbaaa6e4ee0af55bb30e6494063, d32f7cba9853481cbfb04e3e668a9505, ffe5259ebd124166b43c2c506cf4315f; no voters:
I20260809 02:25:56.064766 29443 raft_consensus.cc:2781] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:25:56.064872 29443 raft_consensus.cc:482] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:25:56.064934 29443 raft_consensus.cc:3037] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:56.066043 29443 raft_consensus.cc:504] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d32f7cba9853481cbfb04e3e668a9505" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46023 } } peers { permanent_uuid: "14817bbaaa6e4ee0af55bb30e6494063" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39719 } } peers { permanent_uuid: "ffe5259ebd124166b43c2c506cf4315f" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44185 } }
I20260809 02:25:56.066493 29443 leader_election.cc:288] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [CANDIDATE]: Term 1 election: Requested vote from peers 14817bbaaa6e4ee0af55bb30e6494063 (127.21.214.129:39719), ffe5259ebd124166b43c2c506cf4315f (127.21.214.130:44185)
I20260809 02:25:56.066817 28939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b59332c894f24411857a76a6819f0076" candidate_uuid: "d32f7cba9853481cbfb04e3e668a9505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14817bbaaa6e4ee0af55bb30e6494063"
I20260809 02:25:56.066933 29142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b59332c894f24411857a76a6819f0076" candidate_uuid: "d32f7cba9853481cbfb04e3e668a9505" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffe5259ebd124166b43c2c506cf4315f"
I20260809 02:25:56.066952 28939 raft_consensus.cc:3037] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:56.067059 29142 raft_consensus.cc:3037] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:56.068112 28939 raft_consensus.cc:2454] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32f7cba9853481cbfb04e3e668a9505 in term 1.
I20260809 02:25:56.068213 29142 raft_consensus.cc:2454] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d32f7cba9853481cbfb04e3e668a9505 in term 1.
I20260809 02:25:56.068449 29246 leader_election.cc:302] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14817bbaaa6e4ee0af55bb30e6494063, d32f7cba9853481cbfb04e3e668a9505; no voters:
I20260809 02:25:56.068619 29443 raft_consensus.cc:2781] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:56.068843 29443 raft_consensus.cc:686] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [term 1 LEADER]: Becoming Leader. State: Replica: d32f7cba9853481cbfb04e3e668a9505, State: Running, Role: LEADER
I20260809 02:25:56.069198 29443 consensus_queue.cc:237] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d32f7cba9853481cbfb04e3e668a9505" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46023 } } peers { permanent_uuid: "14817bbaaa6e4ee0af55bb30e6494063" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39719 } } peers { permanent_uuid: "ffe5259ebd124166b43c2c506cf4315f" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44185 } }
I20260809 02:25:56.072436 28722 catalog_manager.cc:5495] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 reported cstate change: term changed from 0 to 1, leader changed from <none> to d32f7cba9853481cbfb04e3e668a9505 (127.21.214.131). New cstate: current_term: 1 leader_uuid: "d32f7cba9853481cbfb04e3e668a9505" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d32f7cba9853481cbfb04e3e668a9505" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14817bbaaa6e4ee0af55bb30e6494063" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffe5259ebd124166b43c2c506cf4315f" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44185 } health_report { overall_health: UNKNOWN } } }
W20260809 02:25:56.087971 29405 tablet.cc:2369] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:25:56.121312 29427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:56.117345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41390 (local address 127.21.214.131:46023)
0809 02:25:56.117520 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:56.117528 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:56.117546 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:25:56.117773 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:56.117776 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:56.117836 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:56.117957 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:25:56.118249 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:56.118823 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:56.119770 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:56.120009 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:56.120136 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:56.120454 (+ 318us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:25:56.120843 (+ 389us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:25:56.120980 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:56.121054 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 02:25:56.121123 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260809 02:25:56.122658 29213 tablet.cc:2369] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:25:56.127347 29142 raft_consensus.cc:1261] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f [term 1 FOLLOWER]: Refusing update from remote peer d32f7cba9853481cbfb04e3e668a9505: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:56.127347 28939 raft_consensus.cc:1261] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063 [term 1 FOLLOWER]: Refusing update from remote peer d32f7cba9853481cbfb04e3e668a9505: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:56.128070 29443 consensus_queue.cc:1035] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "14817bbaaa6e4ee0af55bb30e6494063" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:56.128270 29446 consensus_queue.cc:1035] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffe5259ebd124166b43c2c506cf4315f" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:56.140106 29453 mvcc.cc:205] Tried to move back new op lower bound from 7316448690689925120 to 7316448690462322688. Current Snapshot: MvccSnapshot[applied={T|T < 7316448690689925120 or (T in {7316448690689925120})}]
I20260809 02:25:56.145331 28721 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43704:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:56.145512 28721 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43704:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:56.148070 28721 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c9fb0c246b3b402e9c7eed2cece97367: Sending DeleteTablet for 3 replicas of tablet b59332c894f24411857a76a6819f0076
I20260809 02:25:56.148958 29104 tablet_service.cc:1514] Processing DeleteTablet for tablet b59332c894f24411857a76a6819f0076 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:56 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:40622
I20260809 02:25:56.149001 28907 tablet_service.cc:1514] Processing DeleteTablet for tablet b59332c894f24411857a76a6819f0076 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:56 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:53426
I20260809 02:25:56.149065 29313 tablet_service.cc:1514] Processing DeleteTablet for tablet b59332c894f24411857a76a6819f0076 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:56 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:41374
I20260809 02:25:56.149461 29468 tablet_replica.cc:330] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063: stopping tablet replica
I20260809 02:25:56.149727 29469 tablet_replica.cc:330] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505: stopping tablet replica
I20260809 02:25:56.149788 29468 raft_consensus.cc:2229] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:56.150000 29469 raft_consensus.cc:2229] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:25:56.150106 29468 raft_consensus.cc:2258] T b59332c894f24411857a76a6819f0076 P 14817bbaaa6e4ee0af55bb30e6494063 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:56.150183 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 28816
I20260809 02:25:56.150367 29469 raft_consensus.cc:2258] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:56.150705 29467 tablet_replica.cc:330] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f: stopping tablet replica
I20260809 02:25:56.150965 29467 raft_consensus.cc:2229] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:56.151232 29467 raft_consensus.cc:2258] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:56.154389 29467 ts_tablet_manager.cc:1905] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:56.157150 29467 ts_tablet_manager.cc:1918] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:25:56.157262 29467 log.cc:1196] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/b59332c894f24411857a76a6819f0076
I20260809 02:25:56.157575 29467 ts_tablet_manager.cc:1939] T b59332c894f24411857a76a6819f0076 P ffe5259ebd124166b43c2c506cf4315f: Deleting consensus metadata
I20260809 02:25:56.159866 29469 ts_tablet_manager.cc:1905] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:56.162403 29469 ts_tablet_manager.cc:1918] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:25:56.162525 29469 log.cc:1196] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/b59332c894f24411857a76a6819f0076
I20260809 02:25:56.162744 28706 catalog_manager.cc:4841] TS ffe5259ebd124166b43c2c506cf4315f (127.21.214.130:44185): tablet b59332c894f24411857a76a6819f0076 (table test-table [id=83db79d48d894a9da6f651645b597e41]) successfully deleted
I20260809 02:25:56.162853 29469 ts_tablet_manager.cc:1939] T b59332c894f24411857a76a6819f0076 P d32f7cba9853481cbfb04e3e668a9505: Deleting consensus metadata
W20260809 02:25:56.163380 28703 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:39719 (error 108)
I20260809 02:25:56.163918 28700 catalog_manager.cc:4841] TS d32f7cba9853481cbfb04e3e668a9505 (127.21.214.131:46023): tablet b59332c894f24411857a76a6819f0076 (table test-table [id=83db79d48d894a9da6f651645b597e41]) successfully deleted
I20260809 02:25:56.164501 29428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:56.164162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:39719 (local address 127.0.0.1:53440)
0809 02:25:56.164306 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:56.164393 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:39719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 02:25:56.164613 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 29013
W20260809 02:25:56.164731 28703 catalog_manager.cc:4584] TS 14817bbaaa6e4ee0af55bb30e6494063 (127.21.214.129:39719): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b59332c894f24411857a76a6819f0076: Network error: Client connection negotiation failed: client connection to 127.21.214.129:39719: connect: Connection refused (error 111)
I20260809 02:25:56.183518 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 29218
I20260809 02:25:56.195262 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 28674
2026-08-09T02:25:56Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2757 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T02:25:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:56Z Disabled control of system clock
I20260809 02:25:56.234202 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:45781
--webserver_interface=127.21.214.190
--webserver_port=0
--builtin_ntp_servers=127.21.214.148:43933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:45781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 02:25:56.359372 29477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:56.359715 29477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:56.359758 29477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:56.363729 29477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:56.363780 29477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:56.363796 29477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:56.363813 29477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:56.363828 29477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:25:56.368532 29477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:45781
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:45781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:56.369593 29477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:56.371083 29477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:56.380173 29482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:56.380270 29487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:56.380167 29484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:56.380501 29477 server_base.cc:1034] running on GCE node
I20260809 02:25:56.381210 29477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:56.382297 29477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:56.383493 29477 hybrid_clock.cc:648] HybridClock initialized: now 1786242356383474 us; error 77 us; skew 500 ppm
I20260809 02:25:56.385504 29477 webserver.cc:460] Webserver started at http://127.21.214.190:43493/ using document root <none> and password file <none>
I20260809 02:25:56.386082 29477 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:56.386185 29477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:56.386452 29477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:56.388509 29477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "338902b074064671ae14d8c594618266"
format_stamp: "Formatted at 2026-08-09 02:25:56 on dist-test-slave-68xk"
server_key: "113d13b162540c5e84903f644daac27c"
server_key_iv: "4564b81ef3fa881e2966ed36ad8fdf5f"
server_key_version: "encryptionkey@0"
I20260809 02:25:56.389158 29477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "338902b074064671ae14d8c594618266"
format_stamp: "Formatted at 2026-08-09 02:25:56 on dist-test-slave-68xk"
server_key: "113d13b162540c5e84903f644daac27c"
server_key_iv: "4564b81ef3fa881e2966ed36ad8fdf5f"
server_key_version: "encryptionkey@0"
I20260809 02:25:56.392961 29477 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:25:56.395484 29494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:56.396734 29477 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:56.396871 29477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "338902b074064671ae14d8c594618266"
format_stamp: "Formatted at 2026-08-09 02:25:56 on dist-test-slave-68xk"
server_key: "113d13b162540c5e84903f644daac27c"
server_key_iv: "4564b81ef3fa881e2966ed36ad8fdf5f"
server_key_version: "encryptionkey@0"
I20260809 02:25:56.396984 29477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:56.401660 29477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:56.402281 29477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:56.402522 29477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:56.409703 29477 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:45781
I20260809 02:25:56.409714 29582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:45781 every 8 connection(s)
I20260809 02:25:56.410737 29477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:56.413954 29585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:56.419692 29585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266: Bootstrap starting.
I20260809 02:25:56.420526 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 29477
I20260809 02:25:56.420675 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:56.420943 22362 external_mini_cluster.cc:1428] Setting key 3b17399b487e2674aeba154e6780e856
I20260809 02:25:56.422695 29585 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:56.423621 29585 log.cc:824] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:56.426002 29585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266: No bootstrap required, opened a new log
I20260809 02:25:56.427035 29589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:56.422232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49942 (local address 127.21.214.190:45781)
0809 02:25:56.423067 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:56.423087 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:56.423132 (+ 45us) server_negotiation.cc:407] Connection header received
0809 02:25:56.424020 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:56.424045 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:56.424346 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:56.424700 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:56.425478 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:56.425484 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:56.425498 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:56.425509 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:56.425577 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:56.425601 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:56.425722 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:56.425819 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 02:25:56.426065 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":160,"threads_started":1}
I20260809 02:25:56.430181 29585 raft_consensus.cc:348] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "338902b074064671ae14d8c594618266" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45781 } }
I20260809 02:25:56.430403 29585 raft_consensus.cc:374] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:56.430501 29585 raft_consensus.cc:729] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338902b074064671ae14d8c594618266, State: Initialized, Role: FOLLOWER
I20260809 02:25:56.430879 29585 consensus_queue.cc:260] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "338902b074064671ae14d8c594618266" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45781 } }
I20260809 02:25:56.430995 29585 raft_consensus.cc:388] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:56.431034 29585 raft_consensus.cc:482] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:56.431103 29585 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:56.432085 29585 raft_consensus.cc:504] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "338902b074064671ae14d8c594618266" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45781 } }
I20260809 02:25:56.432446 29585 leader_election.cc:302] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 338902b074064671ae14d8c594618266; no voters:
I20260809 02:25:56.432760 29585 leader_election.cc:288] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:56.432902 29591 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:56.433197 29591 raft_consensus.cc:686] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [term 1 LEADER]: Becoming Leader. State: Replica: 338902b074064671ae14d8c594618266, State: Running, Role: LEADER
I20260809 02:25:56.433516 29591 consensus_queue.cc:237] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "338902b074064671ae14d8c594618266" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45781 } }
I20260809 02:25:56.434031 29585 sys_catalog.cc:564] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:56.435429 29592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "338902b074064671ae14d8c594618266" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "338902b074064671ae14d8c594618266" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45781 } } }
I20260809 02:25:56.435453 29593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 338902b074064671ae14d8c594618266. Latest consensus state: current_term: 1 leader_uuid: "338902b074064671ae14d8c594618266" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "338902b074064671ae14d8c594618266" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45781 } } }
I20260809 02:25:56.435663 29592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:56.435698 29593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266 [sys.catalog]: This master's current role is: LEADER
W20260809 02:25:56.439185 29615 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:25:56.439281 29615 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:25:56.439373 29614 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:56.440202 29614 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:56.446336 29614 catalog_manager.cc:1347] Generated new cluster ID: 71210e51d49c41d98522e552c5e82618
I20260809 02:25:56.446439 29614 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:56.472003 29614 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:56.472399 29614 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:56.480423 29614 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266: Generated new TSK 0
I20260809 02:25:56.481127 29614 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:56.484928 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45781
--builtin_ntp_servers=127.21.214.148:43933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 02:25:56.604290 29625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:56.604545 29625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:56.604585 29625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:56.608592 29625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:56.608644 29625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:56.608698 29625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:25:56.613310 29625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45781
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:56.614339 29625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:56.615726 29625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:56.625438 29634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:56.625435 29633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:56.625488 29625 server_base.cc:1034] running on GCE node
W20260809 02:25:56.625438 29636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:56.626086 29625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:56.626775 29625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:56.627956 29625 hybrid_clock.cc:648] HybridClock initialized: now 1786242356627939 us; error 30 us; skew 500 ppm
I20260809 02:25:56.629815 29625 webserver.cc:460] Webserver started at http://127.21.214.129:44625/ using document root <none> and password file <none>
I20260809 02:25:56.630399 29625 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:56.630541 29625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:56.630789 29625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:56.632830 29625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "c7c2cd07f820488fa9dc5932fa59cb12"
format_stamp: "Formatted at 2026-08-09 02:25:56 on dist-test-slave-68xk"
server_key: "28ad78dd01aa61539cb143fb485f03e4"
server_key_iv: "a3247e965f378fd34cb6aebfb5cd71af"
server_key_version: "encryptionkey@0"
I20260809 02:25:56.633399 29625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "c7c2cd07f820488fa9dc5932fa59cb12"
format_stamp: "Formatted at 2026-08-09 02:25:56 on dist-test-slave-68xk"
server_key: "28ad78dd01aa61539cb143fb485f03e4"
server_key_iv: "a3247e965f378fd34cb6aebfb5cd71af"
server_key_version: "encryptionkey@0"
I20260809 02:25:56.637246 29625 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260809 02:25:56.639932 29643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:56.641211 29625 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:25:56.641355 29625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "c7c2cd07f820488fa9dc5932fa59cb12"
format_stamp: "Formatted at 2026-08-09 02:25:56 on dist-test-slave-68xk"
server_key: "28ad78dd01aa61539cb143fb485f03e4"
server_key_iv: "a3247e965f378fd34cb6aebfb5cd71af"
server_key_version: "encryptionkey@0"
I20260809 02:25:56.641474 29625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:56.646039 29625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:56.646696 29625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:56.646873 29625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:56.647396 29625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:56.648285 29625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:56.648365 29625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:56.648449 29625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:56.648495 29625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:56.657956 29625 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:32897
I20260809 02:25:56.657979 29813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:32897 every 8 connection(s)
I20260809 02:25:56.658881 29625 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:25:56.662186 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 29625
I20260809 02:25:56.662313 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:25:56.662639 22362 external_mini_cluster.cc:1428] Setting key 028752f72b804b79b69b69d1627529ce
I20260809 02:25:56.664767 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45781
--builtin_ntp_servers=127.21.214.148:43933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 02:25:56.665542 29589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:56.660680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:47167 (local address 127.21.214.190:45781)
0809 02:25:56.660817 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:56.660821 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:56.661846 (+ 1025us) server_negotiation.cc:407] Connection header received
0809 02:25:56.663619 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:56.663622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:56.663663 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:56.663748 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:56.665000 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:56.665006 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:56.665011 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:56.665028 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:56.665064 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:56.665084 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:56.665149 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:56.665399 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 02:25:56.665440 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:25:56.666688 29816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:56.661045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45781 (local address 127.21.214.129:47167)
0809 02:25:56.661706 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:56.661744 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:56.663408 (+ 1664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:56.663929 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:56.663938 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:56.664049 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:56.664675 (+ 626us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:25:56.664678 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:56.664729 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:25:56.664816 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:56.665229 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:56.665240 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:56.665248 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 02:25:56.665423 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 02:25:56.665660 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":137,"threads_started":1}
I20260809 02:25:56.667941 29814 heartbeater.cc:347] Connected to a master server at 127.21.214.190:45781
I20260809 02:25:56.668170 29814 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:56.668558 29814 heartbeater.cc:511] Master 127.21.214.190:45781 requested a full tablet report, sending...
I20260809 02:25:56.670099 29521 ts_manager.cc:194] Registered new tserver with Master: c7c2cd07f820488fa9dc5932fa59cb12 (127.21.214.129:32897)
W20260809 02:25:56.777846 29817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:56.778120 29817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:56.778189 29817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:56.782658 29817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:56.782740 29817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:56.782826 29817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:25:56.787652 29817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45781
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:56.788712 29817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:56.790123 29817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:56.799968 29825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:56.799978 29822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:56.799976 29823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:56.800091 29817 server_base.cc:1034] running on GCE node
I20260809 02:25:56.800704 29817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:56.801292 29817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:56.802492 29817 hybrid_clock.cc:648] HybridClock initialized: now 1786242356802459 us; error 64 us; skew 500 ppm
I20260809 02:25:56.804376 29817 webserver.cc:460] Webserver started at http://127.21.214.130:38647/ using document root <none> and password file <none>
I20260809 02:25:56.804975 29817 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:56.805079 29817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:56.805300 29817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:56.807430 29817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "d8efd46df1954d86bfe5d00957be6d27"
format_stamp: "Formatted at 2026-08-09 02:25:56 on dist-test-slave-68xk"
server_key: "2f58365e56c04e93e8025778360274cc"
server_key_iv: "2ae79b9479e57a8057e51ca8c93b4848"
server_key_version: "encryptionkey@0"
I20260809 02:25:56.808007 29817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "d8efd46df1954d86bfe5d00957be6d27"
format_stamp: "Formatted at 2026-08-09 02:25:56 on dist-test-slave-68xk"
server_key: "2f58365e56c04e93e8025778360274cc"
server_key_iv: "2ae79b9479e57a8057e51ca8c93b4848"
server_key_version: "encryptionkey@0"
I20260809 02:25:56.811646 29817 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:25:56.814190 29836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:56.815583 29817 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:56.815747 29817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "d8efd46df1954d86bfe5d00957be6d27"
format_stamp: "Formatted at 2026-08-09 02:25:56 on dist-test-slave-68xk"
server_key: "2f58365e56c04e93e8025778360274cc"
server_key_iv: "2ae79b9479e57a8057e51ca8c93b4848"
server_key_version: "encryptionkey@0"
I20260809 02:25:56.815860 29817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:56.820392 29817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:56.820992 29817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:56.821179 29817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:56.821744 29817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:56.822717 29817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:56.822784 29817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:56.822853 29817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:56.822892 29817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:56.831722 29817 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:33929
I20260809 02:25:56.831743 30021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:33929 every 8 connection(s)
I20260809 02:25:56.832605 29817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:25:56.839059 29589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:56.834465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:34335 (local address 127.21.214.190:45781)
0809 02:25:56.834629 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:56.834635 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:56.835840 (+ 1205us) server_negotiation.cc:407] Connection header received
0809 02:25:56.837143 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:56.837146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:56.837204 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:56.837283 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:56.838529 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:56.838532 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:56.838534 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:56.838547 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:56.838568 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:56.838577 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:56.838694 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:56.838893 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 02:25:56.838947 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:25:56.839888 30025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:56.834954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45781 (local address 127.21.214.130:34335)
0809 02:25:56.835698 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:56.835737 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:56.836950 (+ 1213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:56.837437 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:56.837443 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:56.837527 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:56.838211 (+ 684us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:25:56.838212 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:56.838252 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:25:56.838321 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:56.838701 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:56.838710 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:56.838715 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:25:56.838869 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 02:25:56.839060 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":125,"threads_started":1}
I20260809 02:25:56.841004 30023 heartbeater.cc:347] Connected to a master server at 127.21.214.190:45781
I20260809 02:25:56.841271 30023 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:56.841693 30023 heartbeater.cc:511] Master 127.21.214.190:45781 requested a full tablet report, sending...
I20260809 02:25:56.842555 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 29817
I20260809 02:25:56.842707 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:25:56.842872 29521 ts_manager.cc:194] Registered new tserver with Master: d8efd46df1954d86bfe5d00957be6d27 (127.21.214.130:33929)
I20260809 02:25:56.843022 22362 external_mini_cluster.cc:1428] Setting key 05721c747cea64b9c2287d521c285ee6
I20260809 02:25:56.845211 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45781
--builtin_ntp_servers=127.21.214.148:43933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 02:25:56.963245 30026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:56.963498 30026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:56.963538 30026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:56.967666 30026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:56.967723 30026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:56.967813 30026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:25:56.972528 30026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45781
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:56.973606 30026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:56.975031 30026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:56.984681 30044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:56.984712 30039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:56.984719 30041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:56.985057 30026 server_base.cc:1034] running on GCE node
I20260809 02:25:56.985430 30026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:56.986040 30026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:56.987206 30026 hybrid_clock.cc:648] HybridClock initialized: now 1786242356987187 us; error 39 us; skew 500 ppm
I20260809 02:25:56.989022 30026 webserver.cc:460] Webserver started at http://127.21.214.131:43503/ using document root <none> and password file <none>
I20260809 02:25:56.989564 30026 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:56.989636 30026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:56.989800 30026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:56.991842 30026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "d6b54ed72639415bae2017844e767ebd"
format_stamp: "Formatted at 2026-08-09 02:25:56 on dist-test-slave-68xk"
server_key: "d0d8e0b09c4d084b7898a65a7293b5f6"
server_key_iv: "f63c1432e4baf651d4e44b16da1ae99d"
server_key_version: "encryptionkey@0"
I20260809 02:25:56.992354 30026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "d6b54ed72639415bae2017844e767ebd"
format_stamp: "Formatted at 2026-08-09 02:25:56 on dist-test-slave-68xk"
server_key: "d0d8e0b09c4d084b7898a65a7293b5f6"
server_key_iv: "f63c1432e4baf651d4e44b16da1ae99d"
server_key_version: "encryptionkey@0"
I20260809 02:25:56.996032 30026 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:25:56.998553 30054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:56.999775 30026 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:56.999912 30026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "d6b54ed72639415bae2017844e767ebd"
format_stamp: "Formatted at 2026-08-09 02:25:56 on dist-test-slave-68xk"
server_key: "d0d8e0b09c4d084b7898a65a7293b5f6"
server_key_iv: "f63c1432e4baf651d4e44b16da1ae99d"
server_key_version: "encryptionkey@0"
I20260809 02:25:57.000003 30026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:57.004523 30026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:57.005172 30026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:57.005368 30026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:57.005918 30026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:25:57.006896 30026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:25:57.006965 30026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:57.007041 30026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:25:57.007081 30026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:57.017395 30026 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:37145
I20260809 02:25:57.017457 30222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:37145 every 8 connection(s)
I20260809 02:25:57.018328 30026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:25:57.022879 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 30026
I20260809 02:25:57.023015 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:25:57.023351 22362 external_mini_cluster.cc:1428] Setting key faf2ca9ab667226152b28c7058b99fdc
I20260809 02:25:57.025097 29589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.020259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:53655 (local address 127.21.214.190:45781)
0809 02:25:57.020401 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:57.020405 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:57.021530 (+ 1125us) server_negotiation.cc:407] Connection header received
0809 02:25:57.023232 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:57.023235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:57.023284 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:57.023352 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:57.024615 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:57.024619 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:57.024622 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:57.024634 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:57.024668 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:57.024677 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:57.024777 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:57.024943 (+ 166us) server_negotiation.cc:299] Negotiation successful
0809 02:25:57.024981 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:25:57.026073 30226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.020692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45781 (local address 127.21.214.131:53655)
0809 02:25:57.021360 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:57.021399 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:57.022939 (+ 1540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:57.023565 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:57.023574 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:57.023683 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:57.024318 (+ 635us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:25:57.024321 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:57.024375 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:25:57.024463 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:57.024786 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:57.024794 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:57.024799 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:25:57.024975 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 02:25:57.025225 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":111,"threads_started":1}
I20260809 02:25:57.027082 30223 heartbeater.cc:347] Connected to a master server at 127.21.214.190:45781
I20260809 02:25:57.027321 30223 heartbeater.cc:464] Registering TS with master...
I20260809 02:25:57.027732 30223 heartbeater.cc:511] Master 127.21.214.190:45781 requested a full tablet report, sending...
I20260809 02:25:57.028769 29521 ts_manager.cc:194] Registered new tserver with Master: d6b54ed72639415bae2017844e767ebd (127.21.214.131:37145)
I20260809 02:25:57.037331 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:25:57.040629 29589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.039203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49952 (local address 127.21.214.190:45781)
0809 02:25:57.039320 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:57.039325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:57.039484 (+ 159us) server_negotiation.cc:407] Connection header received
0809 02:25:57.039597 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:57.039599 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:57.039633 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:57.039706 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:57.040350 (+ 644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:57.040352 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:57.040355 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:57.040365 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:57.040384 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:57.040392 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:57.040455 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:57.040501 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 02:25:57.040531 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:25:57.043437 29521 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49952:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:25:57.046631 29521 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:25:57.058879 30245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.055751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:37145 (local address 127.0.0.1:43910)
0809 02:25:57.056487 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:57.056501 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:57.056570 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:57.057207 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:57.057214 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:57.057292 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:57.057997 (+ 705us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:25:57.058001 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:57.058018 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:25:57.058102 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:57.058559 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:57.058561 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:57.058565 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:25:57.058649 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 02:25:57.058728 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"mutex_wait_us":2,"thread_start_us":90,"threads_started":1}
I20260809 02:25:57.059094 30246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.056100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43910 (local address 127.21.214.131:37145)
0809 02:25:57.056801 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:57.056816 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:57.056839 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:25:57.056892 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:57.056899 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:57.057054 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:57.057220 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:57.058350 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:57.058353 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:57.058361 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:57.058369 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:57.058398 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:57.058456 (+ 58us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:57.058812 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:57.058856 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 02:25:57.058926 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":105,"threads_started":1}
I20260809 02:25:57.059230 30243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.055251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40056 (local address 127.21.214.129:32897)
0809 02:25:57.055814 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:57.055826 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:57.055990 (+ 164us) server_negotiation.cc:407] Connection header received
0809 02:25:57.056191 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:57.056200 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:57.056390 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:57.056509 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:57.058276 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:57.058283 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:57.058296 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:57.058312 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:57.058365 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:57.058401 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:57.058545 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:57.058696 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 02:25:57.058810 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":129,"threads_started":1}
I20260809 02:25:57.060307 30240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.054959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:33929 (local address 127.0.0.1:59874)
0809 02:25:57.055818 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:57.055871 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:57.055976 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:57.057207 (+ 1231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:57.057214 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:57.057292 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:57.057991 (+ 699us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:25:57.057994 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:57.058018 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:25:57.058096 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:57.060053 (+ 1957us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:57.060057 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:57.060060 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:25:57.060158 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 02:25:57.060194 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":124,"threads_started":1}
I20260809 02:25:57.060441 30241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.055080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59874 (local address 127.21.214.130:33929)
0809 02:25:57.055730 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:57.055743 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:57.056093 (+ 350us) server_negotiation.cc:407] Connection header received
0809 02:25:57.056161 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:57.056170 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:57.056378 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:57.056513 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:57.058276 (+ 1763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:57.058292 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:57.058306 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:57.058321 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:57.058364 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:57.058401 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:57.058546 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:57.060209 (+ 1663us) server_negotiation.cc:299] Negotiation successful
0809 02:25:57.060271 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":152,"threads_started":1}
I20260809 02:25:57.061264 30238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.055000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:32897 (local address 127.0.0.1:40056)
0809 02:25:57.055883 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:57.055899 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:57.056058 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:57.057230 (+ 1172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:57.057233 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:57.057292 (+ 59us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:57.058059 (+ 767us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:25:57.058064 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:57.058076 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:25:57.058110 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:57.058526 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:57.058538 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:57.058547 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 02:25:57.058664 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 02:25:57.058721 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":814,"spinlock_wait_cycles":23424,"thread_start_us":112,"threads_started":1}
I20260809 02:25:57.062345 30104 tablet_service.cc:1467] Processing CreateTablet for tablet 43a769d0a6b94fae8c59237beb78d1ef (DEFAULT_TABLE table=test-table [id=662208403659495dadab9b338d0f4467]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:57.063474 30104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43a769d0a6b94fae8c59237beb78d1ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:57.063135 29914 tablet_service.cc:1467] Processing CreateTablet for tablet 43a769d0a6b94fae8c59237beb78d1ef (DEFAULT_TABLE table=test-table [id=662208403659495dadab9b338d0f4467]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:57.064175 29914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43a769d0a6b94fae8c59237beb78d1ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:57.063927 29718 tablet_service.cc:1467] Processing CreateTablet for tablet 43a769d0a6b94fae8c59237beb78d1ef (DEFAULT_TABLE table=test-table [id=662208403659495dadab9b338d0f4467]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:25:57.064915 29718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43a769d0a6b94fae8c59237beb78d1ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:57.069849 30248 tablet_bootstrap.cc:492] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd: Bootstrap starting.
I20260809 02:25:57.071894 30251 tablet_bootstrap.cc:492] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12: Bootstrap starting.
I20260809 02:25:57.072634 30250 tablet_bootstrap.cc:492] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27: Bootstrap starting.
I20260809 02:25:57.072898 30248 tablet_bootstrap.cc:654] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:57.073836 30248 log.cc:824] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:57.074107 30251 tablet_bootstrap.cc:654] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:57.074539 30250 tablet_bootstrap.cc:654] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:57.074961 30251 log.cc:824] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:57.075274 30250 log.cc:824] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:57.076062 30248 tablet_bootstrap.cc:492] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd: No bootstrap required, opened a new log
I20260809 02:25:57.076287 30248 ts_tablet_manager.cc:1397] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 02:25:57.076833 30251 tablet_bootstrap.cc:492] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12: No bootstrap required, opened a new log
I20260809 02:25:57.077025 30251 ts_tablet_manager.cc:1397] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:25:57.077257 30250 tablet_bootstrap.cc:492] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27: No bootstrap required, opened a new log
I20260809 02:25:57.077441 30250 ts_tablet_manager.cc:1397] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 02:25:57.079918 30248 raft_consensus.cc:348] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8efd46df1954d86bfe5d00957be6d27" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33929 } } peers { permanent_uuid: "c7c2cd07f820488fa9dc5932fa59cb12" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 32897 } } peers { permanent_uuid: "d6b54ed72639415bae2017844e767ebd" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 37145 } }
I20260809 02:25:57.080166 30248 raft_consensus.cc:374] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:57.080229 30248 raft_consensus.cc:729] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6b54ed72639415bae2017844e767ebd, State: Initialized, Role: FOLLOWER
I20260809 02:25:57.080677 30248 consensus_queue.cc:260] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8efd46df1954d86bfe5d00957be6d27" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33929 } } peers { permanent_uuid: "c7c2cd07f820488fa9dc5932fa59cb12" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 32897 } } peers { permanent_uuid: "d6b54ed72639415bae2017844e767ebd" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 37145 } }
I20260809 02:25:57.081357 30223 heartbeater.cc:503] Master 127.21.214.190:45781 was elected leader, sending a full tablet report...
I20260809 02:25:57.081679 30248 ts_tablet_manager.cc:1428] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260809 02:25:57.081667 30251 raft_consensus.cc:348] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8efd46df1954d86bfe5d00957be6d27" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33929 } } peers { permanent_uuid: "c7c2cd07f820488fa9dc5932fa59cb12" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 32897 } } peers { permanent_uuid: "d6b54ed72639415bae2017844e767ebd" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 37145 } }
I20260809 02:25:57.081923 30251 raft_consensus.cc:374] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:57.081980 30251 raft_consensus.cc:729] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c2cd07f820488fa9dc5932fa59cb12, State: Initialized, Role: FOLLOWER
I20260809 02:25:57.082392 30251 consensus_queue.cc:260] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8efd46df1954d86bfe5d00957be6d27" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33929 } } peers { permanent_uuid: "c7c2cd07f820488fa9dc5932fa59cb12" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 32897 } } peers { permanent_uuid: "d6b54ed72639415bae2017844e767ebd" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 37145 } }
I20260809 02:25:57.082785 30250 raft_consensus.cc:348] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8efd46df1954d86bfe5d00957be6d27" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33929 } } peers { permanent_uuid: "c7c2cd07f820488fa9dc5932fa59cb12" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 32897 } } peers { permanent_uuid: "d6b54ed72639415bae2017844e767ebd" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 37145 } }
I20260809 02:25:57.083078 29814 heartbeater.cc:503] Master 127.21.214.190:45781 was elected leader, sending a full tablet report...
I20260809 02:25:57.083036 30250 raft_consensus.cc:374] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:57.083171 30250 raft_consensus.cc:729] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8efd46df1954d86bfe5d00957be6d27, State: Initialized, Role: FOLLOWER
I20260809 02:25:57.083382 30251 ts_tablet_manager.cc:1428] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260809 02:25:57.083564 30250 consensus_queue.cc:260] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8efd46df1954d86bfe5d00957be6d27" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33929 } } peers { permanent_uuid: "c7c2cd07f820488fa9dc5932fa59cb12" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 32897 } } peers { permanent_uuid: "d6b54ed72639415bae2017844e767ebd" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 37145 } }
I20260809 02:25:57.084218 30023 heartbeater.cc:503] Master 127.21.214.190:45781 was elected leader, sending a full tablet report...
I20260809 02:25:57.084533 30250 ts_tablet_manager.cc:1428] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260809 02:25:57.084924 30024 tablet.cc:2369] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:25:57.160115 29815 tablet.cc:2369] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:25:57.202548 30261 raft_consensus.cc:482] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:25:57.202788 30261 raft_consensus.cc:504] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8efd46df1954d86bfe5d00957be6d27" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33929 } } peers { permanent_uuid: "c7c2cd07f820488fa9dc5932fa59cb12" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 32897 } } peers { permanent_uuid: "d6b54ed72639415bae2017844e767ebd" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 37145 } }
I20260809 02:25:57.204125 30261 leader_election.cc:288] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c2cd07f820488fa9dc5932fa59cb12 (127.21.214.129:32897), d6b54ed72639415bae2017844e767ebd (127.21.214.131:37145)
I20260809 02:25:57.206471 30243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.204550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:59825 (local address 127.21.214.129:32897)
0809 02:25:57.204708 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:57.204713 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:57.204730 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:25:57.204781 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:57.204787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:57.204847 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:57.204926 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:57.205893 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:57.205899 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:57.205902 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:57.205919 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:57.205952 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:57.205964 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:57.206082 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:57.206243 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 02:25:57.206303 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:25:57.206491 30025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.204338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:32897 (local address 127.21.214.130:59825)
0809 02:25:57.204483 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:57.204500 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:57.204590 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:57.205005 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:57.205008 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:57.205025 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:57.205686 (+ 661us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:25:57.205689 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:57.205702 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:25:57.205733 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:57.206124 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:57.206127 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:57.206131 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:25:57.206248 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 02:25:57.206293 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 02:25:57.206614 30246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.204869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:46083 (local address 127.21.214.131:37145)
0809 02:25:57.205101 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:57.205106 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:57.205121 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:25:57.205166 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:57.205171 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:57.205212 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:57.205318 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:57.206139 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:57.206143 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:57.206146 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:57.206161 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:57.206189 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:57.206203 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:57.206301 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:57.206394 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 02:25:57.206456 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260809 02:25:57.206728 30262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.204420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:37145 (local address 127.21.214.130:46083)
0809 02:25:57.204918 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:57.204935 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:57.205026 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:57.205378 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:57.205381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:57.205398 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:25:57.205945 (+ 547us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:25:57.205947 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:25:57.205958 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:25:57.205986 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:25:57.206300 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:25:57.206303 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:25:57.206306 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 02:25:57.206383 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 02:25:57.206434 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":164,"threads_started":1}
I20260809 02:25:57.207396 29747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43a769d0a6b94fae8c59237beb78d1ef" candidate_uuid: "d8efd46df1954d86bfe5d00957be6d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c2cd07f820488fa9dc5932fa59cb12" is_pre_election: true
I20260809 02:25:57.207401 30144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43a769d0a6b94fae8c59237beb78d1ef" candidate_uuid: "d8efd46df1954d86bfe5d00957be6d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6b54ed72639415bae2017844e767ebd" is_pre_election: true
I20260809 02:25:57.207715 30144 raft_consensus.cc:2454] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8efd46df1954d86bfe5d00957be6d27 in term 0.
I20260809 02:25:57.207715 29747 raft_consensus.cc:2454] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8efd46df1954d86bfe5d00957be6d27 in term 0.
I20260809 02:25:57.208199 29839 leader_election.cc:302] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d6b54ed72639415bae2017844e767ebd, d8efd46df1954d86bfe5d00957be6d27; no voters:
I20260809 02:25:57.208492 30261 raft_consensus.cc:2781] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:25:57.208578 30261 raft_consensus.cc:482] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:25:57.208742 30261 raft_consensus.cc:3037] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:57.209861 30261 raft_consensus.cc:504] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8efd46df1954d86bfe5d00957be6d27" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33929 } } peers { permanent_uuid: "c7c2cd07f820488fa9dc5932fa59cb12" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 32897 } } peers { permanent_uuid: "d6b54ed72639415bae2017844e767ebd" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 37145 } }
I20260809 02:25:57.210199 30261 leader_election.cc:288] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [CANDIDATE]: Term 1 election: Requested vote from peers c7c2cd07f820488fa9dc5932fa59cb12 (127.21.214.129:32897), d6b54ed72639415bae2017844e767ebd (127.21.214.131:37145)
I20260809 02:25:57.210585 30144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43a769d0a6b94fae8c59237beb78d1ef" candidate_uuid: "d8efd46df1954d86bfe5d00957be6d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6b54ed72639415bae2017844e767ebd"
I20260809 02:25:57.210587 29747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43a769d0a6b94fae8c59237beb78d1ef" candidate_uuid: "d8efd46df1954d86bfe5d00957be6d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c2cd07f820488fa9dc5932fa59cb12"
I20260809 02:25:57.210719 29747 raft_consensus.cc:3037] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:57.210719 30144 raft_consensus.cc:3037] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:57.212095 30144 raft_consensus.cc:2454] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8efd46df1954d86bfe5d00957be6d27 in term 1.
I20260809 02:25:57.212097 29747 raft_consensus.cc:2454] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8efd46df1954d86bfe5d00957be6d27 in term 1.
I20260809 02:25:57.212404 29837 leader_election.cc:302] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7c2cd07f820488fa9dc5932fa59cb12, d8efd46df1954d86bfe5d00957be6d27; no voters:
I20260809 02:25:57.212631 30261 raft_consensus.cc:2781] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:57.212798 30261 raft_consensus.cc:686] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [term 1 LEADER]: Becoming Leader. State: Replica: d8efd46df1954d86bfe5d00957be6d27, State: Running, Role: LEADER
I20260809 02:25:57.213137 30261 consensus_queue.cc:237] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8efd46df1954d86bfe5d00957be6d27" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33929 } } peers { permanent_uuid: "c7c2cd07f820488fa9dc5932fa59cb12" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 32897 } } peers { permanent_uuid: "d6b54ed72639415bae2017844e767ebd" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 37145 } }
I20260809 02:25:57.216259 29519 catalog_manager.cc:5495] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8efd46df1954d86bfe5d00957be6d27 (127.21.214.130). New cstate: current_term: 1 leader_uuid: "d8efd46df1954d86bfe5d00957be6d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8efd46df1954d86bfe5d00957be6d27" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 33929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7c2cd07f820488fa9dc5932fa59cb12" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 32897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6b54ed72639415bae2017844e767ebd" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 37145 } health_report { overall_health: UNKNOWN } } }
I20260809 02:25:57.248209 30241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.246818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59882 (local address 127.21.214.130:33929)
0809 02:25:57.246964 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:57.246967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:57.246981 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:25:57.247057 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:57.247059 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:57.247114 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:57.247190 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:57.247862 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:57.247865 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:57.247867 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:57.247879 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:57.247899 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:57.247907 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:57.247982 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:57.248062 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 02:25:57.248103 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 02:25:57.254043 30144 raft_consensus.cc:1261] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd [term 1 FOLLOWER]: Refusing update from remote peer d8efd46df1954d86bfe5d00957be6d27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:57.254045 29747 raft_consensus.cc:1261] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12 [term 1 FOLLOWER]: Refusing update from remote peer d8efd46df1954d86bfe5d00957be6d27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:25:57.254851 30263 consensus_queue.cc:1035] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c2cd07f820488fa9dc5932fa59cb12" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 32897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:57.255092 30261 consensus_queue.cc:1035] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6b54ed72639415bae2017844e767ebd" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 37145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:25:57.263144 30268 mvcc.cc:205] Tried to move back new op lower bound from 7316448695304949760 to 7316448695147626496. Current Snapshot: MvccSnapshot[applied={T|T < 7316448695304949760}]
I20260809 02:25:57.264336 30272 mvcc.cc:205] Tried to move back new op lower bound from 7316448695304949760 to 7316448695147626496. Current Snapshot: MvccSnapshot[applied={T|T < 7316448695304949760}]
I20260809 02:25:57.264679 30270 mvcc.cc:205] Tried to move back new op lower bound from 7316448695304949760 to 7316448695147626496. Current Snapshot: MvccSnapshot[applied={T|T < 7316448695304949760}]
I20260809 02:25:57.273515 29521 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:57.273674 29521 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:25:57.276285 29521 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 338902b074064671ae14d8c594618266: Sending DeleteTablet for 3 replicas of tablet 43a769d0a6b94fae8c59237beb78d1ef
I20260809 02:25:57.277101 29914 tablet_service.cc:1514] Processing DeleteTablet for tablet 43a769d0a6b94fae8c59237beb78d1ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:57 UTC) from {username='slave'} at 127.0.0.1:59874
I20260809 02:25:57.277100 29718 tablet_service.cc:1514] Processing DeleteTablet for tablet 43a769d0a6b94fae8c59237beb78d1ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:57 UTC) from {username='slave'} at 127.0.0.1:40056
I20260809 02:25:57.277282 30104 tablet_service.cc:1514] Processing DeleteTablet for tablet 43a769d0a6b94fae8c59237beb78d1ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:25:57 UTC) from {username='slave'} at 127.0.0.1:43910
I20260809 02:25:57.277648 30283 tablet_replica.cc:330] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12: stopping tablet replica
I20260809 02:25:57.277979 30283 raft_consensus.cc:2229] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:57.278147 30284 tablet_replica.cc:330] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd: stopping tablet replica
I20260809 02:25:57.278349 30283 raft_consensus.cc:2258] T 43a769d0a6b94fae8c59237beb78d1ef P c7c2cd07f820488fa9dc5932fa59cb12 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:57.278474 30284 raft_consensus.cc:2229] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:25:57.278746 30282 tablet_replica.cc:330] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27: stopping tablet replica
I20260809 02:25:57.278879 30284 raft_consensus.cc:2258] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:57.279021 30282 raft_consensus.cc:2229] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:25:57.279428 30282 raft_consensus.cc:2258] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:25:57.278391 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 29625
I20260809 02:25:57.284343 30282 ts_tablet_manager.cc:1905] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:57.286824 30282 ts_tablet_manager.cc:1918] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:25:57.286911 30282 log.cc:1196] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/43a769d0a6b94fae8c59237beb78d1ef
I20260809 02:25:57.287213 30282 ts_tablet_manager.cc:1939] T 43a769d0a6b94fae8c59237beb78d1ef P d8efd46df1954d86bfe5d00957be6d27: Deleting consensus metadata
I20260809 02:25:57.288751 29502 catalog_manager.cc:4841] TS d8efd46df1954d86bfe5d00957be6d27 (127.21.214.130:33929): tablet 43a769d0a6b94fae8c59237beb78d1ef (table test-table [id=662208403659495dadab9b338d0f4467]) successfully deleted
I20260809 02:25:57.299257 30284 ts_tablet_manager.cc:1905] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:25:57.302188 30284 ts_tablet_manager.cc:1918] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:25:57.302311 30284 log.cc:1196] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/43a769d0a6b94fae8c59237beb78d1ef
I20260809 02:25:57.302680 30284 ts_tablet_manager.cc:1939] T 43a769d0a6b94fae8c59237beb78d1ef P d6b54ed72639415bae2017844e767ebd: Deleting consensus metadata
I20260809 02:25:57.303865 29500 catalog_manager.cc:4841] TS d6b54ed72639415bae2017844e767ebd (127.21.214.131:37145): tablet 43a769d0a6b94fae8c59237beb78d1ef (table test-table [id=662208403659495dadab9b338d0f4467]) successfully deleted
W20260809 02:25:57.309625 29498 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:32897 (error 108)
I20260809 02:25:57.309760 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 29817
I20260809 02:25:57.313416 30238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.312329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:32897 (local address 127.0.0.1:40066)
0809 02:25:57.313252 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:57.313327 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:32897: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":818}
W20260809 02:25:57.317157 29498 catalog_manager.cc:4584] TS c7c2cd07f820488fa9dc5932fa59cb12 (127.21.214.129:32897): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 43a769d0a6b94fae8c59237beb78d1ef: Network error: Client connection negotiation failed: client connection to 127.21.214.129:32897: connect: Connection refused (error 111)
I20260809 02:25:57.327318 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 30026
I20260809 02:25:57.339902 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 29477
2026-08-09T02:25:57Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1143 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 02:25:57.368395 22362 mini_oidc.cc:152] Starting JWKS server
I20260809 02:25:57.370034 22362 webserver.cc:460] Webserver started at https://127.0.0.1:38097/ using document root <none> and password file <none>
I20260809 02:25:57.370239 22362 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 02:25:57.370582 22362 webserver.cc:460] Webserver started at http://127.0.0.1:36265/ using document root <none> and password file <none>
2026-08-09T02:25:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:57Z Disabled control of system clock
I20260809 02:25:57.382110 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:38939
--webserver_interface=127.21.214.190
--webserver_port=0
--builtin_ntp_servers=127.21.214.148:34807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:38939
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38097/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/testchainca.cert with env {}
W20260809 02:25:57.494072 30297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:57.494333 30297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:57.494407 30297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:57.498453 30297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:57.498507 30297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:57.498521 30297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:57.498538 30297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:57.498575 30297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 02:25:57.498608 30297 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 02:25:57.498627 30297 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38097/jwks.json
I20260809 02:25:57.503887 30297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:34807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:38939
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:38939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38097/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:57.504911 30297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:57.505904 30297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:57.514349 30304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:57.514396 30303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:57.514619 30297 server_base.cc:1034] running on GCE node
W20260809 02:25:57.514364 30306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:57.515180 30297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:57.516227 30297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:57.517421 30297 hybrid_clock.cc:648] HybridClock initialized: now 1786242357517397 us; error 37 us; skew 500 ppm
I20260809 02:25:57.523924 30297 webserver.cc:460] Webserver started at http://127.21.214.190:37047/ using document root <none> and password file <none>
I20260809 02:25:57.524535 30297 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:57.524627 30297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:57.524858 30297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:57.526924 30297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "1165d293565141aeb4a98d35b33bb3e9"
format_stamp: "Formatted at 2026-08-09 02:25:57 on dist-test-slave-68xk"
server_key: "35d106b0c5ecab2370e2b795efc8ad15"
server_key_iv: "c752681005a5174973604f0e1d8f6a2b"
server_key_version: "encryptionkey@0"
I20260809 02:25:57.527478 30297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "1165d293565141aeb4a98d35b33bb3e9"
format_stamp: "Formatted at 2026-08-09 02:25:57 on dist-test-slave-68xk"
server_key: "35d106b0c5ecab2370e2b795efc8ad15"
server_key_iv: "c752681005a5174973604f0e1d8f6a2b"
server_key_version: "encryptionkey@0"
I20260809 02:25:57.531298 30297 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 02:25:57.533651 30314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:57.534883 30297 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:25:57.535017 30297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "1165d293565141aeb4a98d35b33bb3e9"
format_stamp: "Formatted at 2026-08-09 02:25:57 on dist-test-slave-68xk"
server_key: "35d106b0c5ecab2370e2b795efc8ad15"
server_key_iv: "c752681005a5174973604f0e1d8f6a2b"
server_key_version: "encryptionkey@0"
I20260809 02:25:57.535120 30297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:57.547680 30297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:57.548364 30297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:57.548552 30297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:57.555733 30297 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:38939
I20260809 02:25:57.555768 30404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:38939 every 8 connection(s)
I20260809 02:25:57.556670 30297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:57.558504 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 30297
I20260809 02:25:57.558647 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:57.558935 22362 external_mini_cluster.cc:1428] Setting key 1ffb2c9aefc681095ac89dbfc5e2873f
I20260809 02:25:57.560247 30405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:57.565805 30405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9: Bootstrap starting.
I20260809 02:25:57.567651 30410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.560257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57638 (local address 127.21.214.190:38939)
0809 02:25:57.560859 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:57.560873 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:57.560906 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:25:57.561537 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:57.561552 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:57.561913 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:57.562240 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:57.562672 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:57.563603 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:57.564476 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:57.564932 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:57.565120 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:57.565981 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:57.565989 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:57.566004 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:57.566382 (+ 378us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:57.566488 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:57.566511 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:57.566612 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:57.566735 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 02:25:57.566982 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":137,"threads_started":1}
I20260809 02:25:57.568207 30405 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:57.569144 30405 log.cc:824] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:57.570575 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:57.571467 30405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9: No bootstrap required, opened a new log
I20260809 02:25:57.575536 30405 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1165d293565141aeb4a98d35b33bb3e9" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38939 } }
I20260809 02:25:57.575752 30405 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:57.575835 30405 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1165d293565141aeb4a98d35b33bb3e9, State: Initialized, Role: FOLLOWER
I20260809 02:25:57.576247 30405 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1165d293565141aeb4a98d35b33bb3e9" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38939 } }
I20260809 02:25:57.576387 30405 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:57.576453 30405 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:57.576573 30405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:57.577473 30405 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1165d293565141aeb4a98d35b33bb3e9" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38939 } }
I20260809 02:25:57.577809 30405 leader_election.cc:302] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1165d293565141aeb4a98d35b33bb3e9; no voters:
I20260809 02:25:57.578152 30405 leader_election.cc:288] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:57.578305 30414 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:57.578568 30414 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1165d293565141aeb4a98d35b33bb3e9, State: Running, Role: LEADER
I20260809 02:25:57.578872 30414 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1165d293565141aeb4a98d35b33bb3e9" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38939 } }
I20260809 02:25:57.579386 30405 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:57.580626 30416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1165d293565141aeb4a98d35b33bb3e9. Latest consensus state: current_term: 1 leader_uuid: "1165d293565141aeb4a98d35b33bb3e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1165d293565141aeb4a98d35b33bb3e9" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38939 } } }
I20260809 02:25:57.580641 30415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1165d293565141aeb4a98d35b33bb3e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1165d293565141aeb4a98d35b33bb3e9" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38939 } } }
I20260809 02:25:57.580765 30416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:57.581045 30415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:57.581267 30428 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:57.584076 30428 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:57.589488 30428 catalog_manager.cc:1347] Generated new cluster ID: 3c2242eb598b48279a2f23b6259394b6
I20260809 02:25:57.589557 30428 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:57.597128 30428 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:57.598263 30428 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:57.604262 30428 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1165d293565141aeb4a98d35b33bb3e9: Generated new TSK 0
I20260809 02:25:57.604903 30428 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 02:25:57.632721 30451 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 02:25:57.632902 30451 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 02:25:57.633422 30410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.614509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57654 (local address 127.21.214.190:38939)
0809 02:25:57.614648 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:57.614653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:57.614828 (+ 175us) server_negotiation.cc:407] Connection header received
0809 02:25:57.615007 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:57.615010 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:57.615065 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:57.615177 (+ 112us) server_negotiation.cc:226] Negotiated authn=JWT
0809 02:25:57.615401 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:57.616268 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:57.617175 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:57.617522 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:57.617632 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:57.617939 (+ 307us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 02:25:57.633014 (+ 15075us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38097/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 02:25:57.633274 (+ 260us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57654: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38097/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 02:25:57.633507 30410 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57654: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38097/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 02:25:57.634716 30449 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:57.614376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:38939 (local address 127.0.0.1:57654)
0809 02:25:57.614744 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:57.614757 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:57.614860 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:57.615194 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:57.615196 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:57.615203 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0809 02:25:57.615298 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:57.615302 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:57.616411 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:57.616413 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:57.617051 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:57.617058 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:57.617635 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:57.617637 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:57.617717 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:57.617757 (+ 40us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 02:25:57.633220 (+ 15463us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38097/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 02:25:57.633423 (+ 203us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.21.214.190:38939: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38097/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":118,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.21.214.190:38939: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38097/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 02:25:57.635545 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 30297
2026-08-09T02:25:57Z chronyd exiting
I20260809 02:25:57.680857 22362 test_util.cc:175] -----------------------------------------------
I20260809 02:25:57.680953 22362 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786242328272206-22362-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (314 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 02:25:57.682152 22362 mini_oidc.cc:152] Starting JWKS server
I20260809 02:25:57.683157 22362 webserver.cc:460] Webserver started at https://127.0.0.1:37427/ using document root <none> and password file <none>
I20260809 02:25:57.683250 22362 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 02:25:57.683480 22362 webserver.cc:460] Webserver started at http://127.0.0.1:45949/ using document root <none> and password file <none>
2026-08-09T02:25:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:57Z Disabled control of system clock
I20260809 02:25:57.694964 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:35659
--webserver_interface=127.21.214.190
--webserver_port=0
--builtin_ntp_servers=127.21.214.148:37879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:35659
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37427/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/testchainca.cert with env {}
W20260809 02:25:57.812264 30461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:57.812513 30461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:57.812552 30461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:57.816886 30461 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:57.816947 30461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:57.816963 30461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:57.816980 30461 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:57.817036 30461 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 02:25:57.817076 30461 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 02:25:57.817111 30461 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37427/jwks.json
I20260809 02:25:57.822399 30461 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:37879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:35659
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:35659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37427/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:57.823447 30461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:57.824442 30461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:25:57.833214 30461 server_base.cc:1034] running on GCE node
W20260809 02:25:57.833375 30469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:57.833415 30468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:57.833408 30471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:57.834079 30461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:57.835225 30461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:57.836573 30461 hybrid_clock.cc:648] HybridClock initialized: now 1786242357836553 us; error 31 us; skew 500 ppm
I20260809 02:25:57.838551 30461 webserver.cc:460] Webserver started at http://127.21.214.190:45043/ using document root <none> and password file <none>
I20260809 02:25:57.839174 30461 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:57.839264 30461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:57.839488 30461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:57.841600 30461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "f02759ececb64a029567b9fc0574ee96"
format_stamp: "Formatted at 2026-08-09 02:25:57 on dist-test-slave-68xk"
server_key: "48bfc2bae0eb70434284731f62b7a1b8"
server_key_iv: "d779a719d10f77339515ad51316f324b"
server_key_version: "encryptionkey@0"
I20260809 02:25:57.842185 30461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "f02759ececb64a029567b9fc0574ee96"
format_stamp: "Formatted at 2026-08-09 02:25:57 on dist-test-slave-68xk"
server_key: "48bfc2bae0eb70434284731f62b7a1b8"
server_key_iv: "d779a719d10f77339515ad51316f324b"
server_key_version: "encryptionkey@0"
I20260809 02:25:57.845961 30461 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:25:57.848519 30480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:57.849777 30461 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:25:57.849927 30461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "f02759ececb64a029567b9fc0574ee96"
format_stamp: "Formatted at 2026-08-09 02:25:57 on dist-test-slave-68xk"
server_key: "48bfc2bae0eb70434284731f62b7a1b8"
server_key_iv: "d779a719d10f77339515ad51316f324b"
server_key_version: "encryptionkey@0"
I20260809 02:25:57.850034 30461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:57.871635 30461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:57.872339 30461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:57.872552 30461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:57.879781 30461 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:35659
I20260809 02:25:57.879838 30567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:35659 every 8 connection(s)
I20260809 02:25:57.880750 30461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:57.881105 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 30461
I20260809 02:25:57.881260 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:57.881561 22362 external_mini_cluster.cc:1428] Setting key 6295e890cac15a6968ae5935489d8b92
I20260809 02:25:57.884673 30570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:57.891068 30573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.882974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44554 (local address 127.21.214.190:35659)
0809 02:25:57.883626 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:57.883641 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:57.883681 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:25:57.884340 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:57.884355 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:57.884740 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:57.885078 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:57.885421 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:57.886384 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:57.887844 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:57.888323 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:57.888445 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:57.889335 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:57.889340 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:57.889352 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:57.889734 (+ 382us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:57.889789 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:57.889808 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:57.889889 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:57.890051 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 02:25:57.890333 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":156,"threads_started":1}
I20260809 02:25:57.891525 30570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96: Bootstrap starting.
I20260809 02:25:57.894053 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:57.894124 30570 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:57.895041 30570 log.cc:824] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:57.896920 30570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96: No bootstrap required, opened a new log
I20260809 02:25:57.900424 30570 raft_consensus.cc:348] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f02759ececb64a029567b9fc0574ee96" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 35659 } }
I20260809 02:25:57.900631 30570 raft_consensus.cc:374] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:57.900666 30570 raft_consensus.cc:729] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f02759ececb64a029567b9fc0574ee96, State: Initialized, Role: FOLLOWER
I20260809 02:25:57.901084 30570 consensus_queue.cc:260] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f02759ececb64a029567b9fc0574ee96" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 35659 } }
I20260809 02:25:57.901237 30570 raft_consensus.cc:388] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:57.901281 30570 raft_consensus.cc:482] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:57.901347 30570 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:57.902405 30570 raft_consensus.cc:504] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f02759ececb64a029567b9fc0574ee96" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 35659 } }
I20260809 02:25:57.902828 30570 leader_election.cc:302] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f02759ececb64a029567b9fc0574ee96; no voters:
I20260809 02:25:57.903391 30570 leader_election.cc:288] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:57.903573 30575 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:57.903836 30575 raft_consensus.cc:686] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [term 1 LEADER]: Becoming Leader. State: Replica: f02759ececb64a029567b9fc0574ee96, State: Running, Role: LEADER
I20260809 02:25:57.904212 30575 consensus_queue.cc:237] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f02759ececb64a029567b9fc0574ee96" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 35659 } }
I20260809 02:25:57.904696 30570 sys_catalog.cc:564] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:57.905959 30576 sys_catalog.cc:455] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f02759ececb64a029567b9fc0574ee96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f02759ececb64a029567b9fc0574ee96" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 35659 } } }
I20260809 02:25:57.906118 30576 sys_catalog.cc:458] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:57.906502 30578 sys_catalog.cc:455] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f02759ececb64a029567b9fc0574ee96. Latest consensus state: current_term: 1 leader_uuid: "f02759ececb64a029567b9fc0574ee96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f02759ececb64a029567b9fc0574ee96" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 35659 } } }
I20260809 02:25:57.906702 30578 sys_catalog.cc:458] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:57.906988 30592 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:57.909837 30592 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:57.916060 30592 catalog_manager.cc:1347] Generated new cluster ID: 3ed6567bc81f436fba80cee541af2055
I20260809 02:25:57.916133 30592 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:57.933616 30592 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:57.934954 30592 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:57.944690 30592 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f02759ececb64a029567b9fc0574ee96: Generated new TSK 0
I20260809 02:25:57.945606 30592 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 02:25:57.969872 30620 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 02:25:57.969976 30620 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 02:25:57.970803 30573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:57.954836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44570 (local address 127.21.214.190:35659)
0809 02:25:57.954950 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:57.954954 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:57.955138 (+ 184us) server_negotiation.cc:407] Connection header received
0809 02:25:57.955273 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:57.955276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:57.955332 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:57.955447 (+ 115us) server_negotiation.cc:226] Negotiated authn=JWT
0809 02:25:57.955678 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:57.956512 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:57.957452 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:57.957794 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:57.957903 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:57.958209 (+ 306us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 02:25:57.970371 (+ 12162us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37427/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 02:25:57.970659 (+ 288us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44570: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37427/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":45}
W20260809 02:25:57.970875 30573 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44570: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37427/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 02:25:57.970979 30619 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:57.954712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:35659 (local address 127.0.0.1:44570)
0809 02:25:57.955018 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:57.955042 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:57.955158 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:57.955460 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:57.955462 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:57.955469 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0809 02:25:57.955571 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:57.955576 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:57.956651 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:57.956655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:57.957333 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:57.957343 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:57.957932 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:57.957935 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:57.958011 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:57.958035 (+ 24us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 02:25:57.970626 (+ 12591us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37427/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 02:25:57.970778 (+ 152us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.21.214.190:35659: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37427/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":123,"threads_started":1}
I20260809 02:25:57.971735 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 30461
2026-08-09T02:25:57Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (335 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 02:25:58.017462 22362 mini_oidc.cc:152] Starting JWKS server
I20260809 02:25:58.018318 22362 webserver.cc:460] Webserver started at https://127.0.0.1:38405/ using document root <none> and password file <none>
I20260809 02:25:58.018402 22362 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 02:25:58.018745 22362 webserver.cc:460] Webserver started at http://127.0.0.1:37949/ using document root <none> and password file <none>
2026-08-09T02:25:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:58Z Disabled control of system clock
I20260809 02:25:58.029140 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:36793
--webserver_interface=127.21.214.190
--webserver_port=0
--builtin_ntp_servers=127.21.214.148:45145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:36793
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38405/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 02:25:58.139882 30632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:58.140203 30632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:58.140291 30632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:58.144244 30632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:58.144325 30632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:58.144354 30632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:58.144394 30632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:58.144425 30632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 02:25:58.144455 30632 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 02:25:58.144485 30632 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38405/jwks.json
I20260809 02:25:58.149104 30632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:45145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:36793
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:36793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38405/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:58.150172 30632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:58.151568 30632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:58.160084 30645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:58.160063 30641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:58.160060 30642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:58.160409 30632 server_base.cc:1034] running on GCE node
I20260809 02:25:58.161010 30632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:58.162056 30632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:58.163254 30632 hybrid_clock.cc:648] HybridClock initialized: now 1786242358163223 us; error 42 us; skew 500 ppm
I20260809 02:25:58.165138 30632 webserver.cc:460] Webserver started at http://127.21.214.190:37645/ using document root <none> and password file <none>
I20260809 02:25:58.165814 30632 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:58.165925 30632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:58.166167 30632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:58.168234 30632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "00156a6f53a44526ad85bc2ba3af323e"
format_stamp: "Formatted at 2026-08-09 02:25:58 on dist-test-slave-68xk"
server_key: "b9583309d4fe52370f8f7184a30779ad"
server_key_iv: "e3ad37cb61ada1dea10eba388917a145"
server_key_version: "encryptionkey@0"
I20260809 02:25:58.168794 30632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "00156a6f53a44526ad85bc2ba3af323e"
format_stamp: "Formatted at 2026-08-09 02:25:58 on dist-test-slave-68xk"
server_key: "b9583309d4fe52370f8f7184a30779ad"
server_key_iv: "e3ad37cb61ada1dea10eba388917a145"
server_key_version: "encryptionkey@0"
I20260809 02:25:58.172519 30632 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:25:58.175153 30652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:58.176438 30632 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:25:58.176592 30632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "00156a6f53a44526ad85bc2ba3af323e"
format_stamp: "Formatted at 2026-08-09 02:25:58 on dist-test-slave-68xk"
server_key: "b9583309d4fe52370f8f7184a30779ad"
server_key_iv: "e3ad37cb61ada1dea10eba388917a145"
server_key_version: "encryptionkey@0"
I20260809 02:25:58.176716 30632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:58.200841 30632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:58.201586 30632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:58.201794 30632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:58.209410 30632 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:36793
I20260809 02:25:58.209434 30737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:36793 every 8 connection(s)
I20260809 02:25:58.210398 30632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:58.213766 30738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:58.215240 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 30632
I20260809 02:25:58.215377 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:58.215716 22362 external_mini_cluster.cc:1428] Setting key 93721923fed4781d25a55bae892d5387
I20260809 02:25:58.220584 30738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e: Bootstrap starting.
I20260809 02:25:58.223021 30738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:58.223923 30738 log.cc:824] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:58.225344 30741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:58.217229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38888 (local address 127.21.214.190:36793)
0809 02:25:58.217933 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:58.217950 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:58.217986 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:25:58.218727 (+ 741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:58.218792 (+ 65us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:58.219208 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:58.219543 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:58.220003 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:58.221019 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:58.221894 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:58.222360 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:58.222583 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:58.223509 (+ 926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:58.223515 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:58.223527 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:58.223899 (+ 372us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:58.223951 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:58.223971 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:58.224089 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:58.224299 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 02:25:58.224592 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":153,"threads_started":1}
I20260809 02:25:58.226178 30738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e: No bootstrap required, opened a new log
I20260809 02:25:58.228356 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:58.231040 30738 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00156a6f53a44526ad85bc2ba3af323e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36793 } }
I20260809 02:25:58.231269 30738 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:58.231349 30738 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00156a6f53a44526ad85bc2ba3af323e, State: Initialized, Role: FOLLOWER
I20260809 02:25:58.231829 30738 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00156a6f53a44526ad85bc2ba3af323e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36793 } }
I20260809 02:25:58.231980 30738 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:58.232055 30738 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:58.232185 30738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:58.233139 30738 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00156a6f53a44526ad85bc2ba3af323e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36793 } }
I20260809 02:25:58.233489 30738 leader_election.cc:302] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00156a6f53a44526ad85bc2ba3af323e; no voters:
I20260809 02:25:58.233810 30738 leader_election.cc:288] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:58.233961 30743 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:58.234288 30743 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [term 1 LEADER]: Becoming Leader. State: Replica: 00156a6f53a44526ad85bc2ba3af323e, State: Running, Role: LEADER
I20260809 02:25:58.234645 30743 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00156a6f53a44526ad85bc2ba3af323e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36793 } }
I20260809 02:25:58.235277 30738 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:58.236606 30746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00156a6f53a44526ad85bc2ba3af323e. Latest consensus state: current_term: 1 leader_uuid: "00156a6f53a44526ad85bc2ba3af323e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00156a6f53a44526ad85bc2ba3af323e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36793 } } }
I20260809 02:25:58.236773 30746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:58.237093 30744 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00156a6f53a44526ad85bc2ba3af323e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00156a6f53a44526ad85bc2ba3af323e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36793 } } }
I20260809 02:25:58.237200 30754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:58.237215 30744 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:58.240648 30754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:58.245955 30754 catalog_manager.cc:1347] Generated new cluster ID: 654cb0dc327e49d3837e72a4677c79bb
I20260809 02:25:58.246023 30754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:58.259589 30754 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:58.260603 30754 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:58.273979 30754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00156a6f53a44526ad85bc2ba3af323e: Generated new TSK 0
I20260809 02:25:58.274794 30754 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:58.293385 30741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:58.287764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38898 (local address 127.21.214.190:36793)
0809 02:25:58.287907 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:58.287912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:58.288031 (+ 119us) server_negotiation.cc:407] Connection header received
0809 02:25:58.288184 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:58.288188 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:58.288255 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:58.288393 (+ 138us) server_negotiation.cc:226] Negotiated authn=JWT
0809 02:25:58.288595 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:58.289533 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:58.290465 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:58.290875 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:58.290999 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:58.291293 (+ 294us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 02:25:58.292962 (+ 1669us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38405/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 02:25:58.293221 (+ 259us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38898: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38405/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 02:25:58.293470 30741 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38898: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38405/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 02:25:58.295002 30776 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:58.287652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36793 (local address 127.0.0.1:38898)
0809 02:25:58.287941 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:58.287954 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:58.288053 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:58.288385 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:58.288387 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:58.288393 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0809 02:25:58.288490 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:58.288495 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:58.289659 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:58.289662 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:58.290313 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:58.290320 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:58.291010 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:58.291012 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:58.291077 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:58.291100 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 02:25:58.293142 (+ 2042us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38405/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 02:25:58.294831 (+ 1689us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.21.214.190:36793: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38405/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":1508,"thread_start_us":104,"threads_started":1}
I20260809 02:25:58.295634 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 30632
E20260809 02:25:58.306375 30777 webserver.cc:533] Webserver: sslize failed:
E20260809 02:25:58.306514 30777 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-09T02:25:58Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (322 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T02:25:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:25:58Z Disabled control of system clock
I20260809 02:25:58.350217 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:37219
--webserver_interface=127.21.214.190
--webserver_port=0
--builtin_ntp_servers=127.21.214.148:36175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:37219
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/testchainca.cert with env {}
W20260809 02:25:58.466063 30785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:25:58.466344 30785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:25:58.466387 30785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:25:58.470454 30785 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:25:58.470521 30785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:25:58.470537 30785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:25:58.470554 30785 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:25:58.470570 30785 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 02:25:58.470631 30785 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 02:25:58.470667 30785 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 02:25:58.478592 30785 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:36175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:37219
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:37219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:25:58.480079 30785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:25:58.481765 30785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:25:58.491554 30793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:58.491554 30796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:25:58.491575 30794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:25:58.491816 30785 server_base.cc:1034] running on GCE node
I20260809 02:25:58.492449 30785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:25:58.493549 30785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:25:58.494715 30785 hybrid_clock.cc:648] HybridClock initialized: now 1786242358494689 us; error 50 us; skew 500 ppm
I20260809 02:25:58.496678 30785 webserver.cc:460] Webserver started at http://127.21.214.190:33295/ using document root <none> and password file <none>
I20260809 02:25:58.497223 30785 fs_manager.cc:359] Metadata directory not provided
I20260809 02:25:58.497285 30785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:25:58.497448 30785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:25:58.499497 30785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "57e9503d7ea244b2bb79ab9d2c6fd159"
format_stamp: "Formatted at 2026-08-09 02:25:58 on dist-test-slave-68xk"
server_key: "345abd1d6da46b80d0ee0c4d5833636e"
server_key_iv: "033a17157f6898761d67e599ece9701f"
server_key_version: "encryptionkey@0"
I20260809 02:25:58.500030 30785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "57e9503d7ea244b2bb79ab9d2c6fd159"
format_stamp: "Formatted at 2026-08-09 02:25:58 on dist-test-slave-68xk"
server_key: "345abd1d6da46b80d0ee0c4d5833636e"
server_key_iv: "033a17157f6898761d67e599ece9701f"
server_key_version: "encryptionkey@0"
I20260809 02:25:58.503599 30785 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:25:58.506023 30808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:25:58.507279 30785 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:25:58.507395 30785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "57e9503d7ea244b2bb79ab9d2c6fd159"
format_stamp: "Formatted at 2026-08-09 02:25:58 on dist-test-slave-68xk"
server_key: "345abd1d6da46b80d0ee0c4d5833636e"
server_key_iv: "033a17157f6898761d67e599ece9701f"
server_key_version: "encryptionkey@0"
I20260809 02:25:58.507480 30785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:25:58.535197 30785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:25:58.535861 30785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:25:58.536017 30785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:25:58.543298 30785 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:37219
I20260809 02:25:58.543313 30888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:37219 every 8 connection(s)
I20260809 02:25:58.544240 30785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:25:58.546694 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 30785
I20260809 02:25:58.546800 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:25:58.547096 22362 external_mini_cluster.cc:1428] Setting key 1e709737478e41aafac4266772194944
I20260809 02:25:58.547549 30889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:25:58.555032 30889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159: Bootstrap starting.
I20260809 02:25:58.556799 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:58.548468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34854 (local address 127.21.214.190:37219)
0809 02:25:58.549084 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:58.549101 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:58.549139 (+ 38us) server_negotiation.cc:407] Connection header received
0809 02:25:58.549823 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:58.549839 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:58.550223 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:58.550606 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:25:58.550955 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:58.551928 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:58.553177 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:58.553673 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:58.553805 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:58.554863 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:25:58.554869 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:25:58.554882 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:25:58.555374 (+ 492us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:25:58.555436 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:25:58.555460 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:25:58.555545 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 02:25:58.555719 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 02:25:58.556033 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":142,"threads_started":1}
I20260809 02:25:58.557502 30889 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159: Neither blocks nor log segments found. Creating new log.
I20260809 02:25:58.558391 30889 log.cc:824] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159: Log is configured to *not* fsync() on all Append() calls
I20260809 02:25:58.559969 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:25:58.560843 30889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159: No bootstrap required, opened a new log
I20260809 02:25:58.564800 30889 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e9503d7ea244b2bb79ab9d2c6fd159" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37219 } }
I20260809 02:25:58.565026 30889 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:25:58.565089 30889 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57e9503d7ea244b2bb79ab9d2c6fd159, State: Initialized, Role: FOLLOWER
I20260809 02:25:58.565517 30889 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e9503d7ea244b2bb79ab9d2c6fd159" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37219 } }
I20260809 02:25:58.565662 30889 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:25:58.565707 30889 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:25:58.565775 30889 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:25:58.566789 30889 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e9503d7ea244b2bb79ab9d2c6fd159" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37219 } }
I20260809 02:25:58.567098 30889 leader_election.cc:302] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57e9503d7ea244b2bb79ab9d2c6fd159; no voters:
I20260809 02:25:58.567613 30889 leader_election.cc:288] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:25:58.567760 30898 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:25:58.568011 30898 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [term 1 LEADER]: Becoming Leader. State: Replica: 57e9503d7ea244b2bb79ab9d2c6fd159, State: Running, Role: LEADER
I20260809 02:25:58.568317 30898 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e9503d7ea244b2bb79ab9d2c6fd159" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37219 } }
I20260809 02:25:58.568974 30889 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:25:58.570080 30901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57e9503d7ea244b2bb79ab9d2c6fd159. Latest consensus state: current_term: 1 leader_uuid: "57e9503d7ea244b2bb79ab9d2c6fd159" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e9503d7ea244b2bb79ab9d2c6fd159" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37219 } } }
I20260809 02:25:58.570266 30901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:58.570662 30912 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:25:58.570626 30900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57e9503d7ea244b2bb79ab9d2c6fd159" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57e9503d7ea244b2bb79ab9d2c6fd159" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37219 } } }
I20260809 02:25:58.571291 30900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159 [sys.catalog]: This master's current role is: LEADER
I20260809 02:25:58.573580 30912 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:25:58.579802 30912 catalog_manager.cc:1347] Generated new cluster ID: 07a5d1bec6fd45ca9df05508dd73a8c5
I20260809 02:25:58.579891 30912 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:25:58.600337 30912 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:25:58.601215 30912 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:25:58.611063 30912 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57e9503d7ea244b2bb79ab9d2c6fd159: Generated new TSK 0
I20260809 02:25:58.611824 30912 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:25:59.109707 30893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:25:58.622309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34856 (local address 127.21.214.190:37219)
0809 02:25:58.622462 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:25:58.622467 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:25:58.622643 (+ 176us) server_negotiation.cc:407] Connection header received
0809 02:25:58.622780 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:25:58.622783 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:25:58.622837 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:25:58.622947 (+ 110us) server_negotiation.cc:226] Negotiated authn=JWT
0809 02:25:58.623151 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:58.624074 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:58.624959 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:25:58.625353 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:25:58.625452 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:58.625761 (+ 309us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 02:25:59.109268 (+483507us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 02:25:59.109563 (+ 295us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34856: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 02:25:59.109820 30893 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34856: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 02:25:59.109920 30931 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:25:58.622214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:37219 (local address 127.0.0.1:34856)
0809 02:25:58.622545 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 02:25:58.622558 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:25:58.622669 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:25:58.622960 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:25:58.622962 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:25:58.622968 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0809 02:25:58.623060 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:58.623064 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:58.624203 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:58.624206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:58.624845 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:25:58.624852 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:25:58.625483 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:25:58.625486 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:25:58.625556 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:25:58.625578 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 02:25:59.109512 (+483934us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 02:25:59.109728 (+ 216us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.21.214.190:37219: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":127,"threads_started":1}
I20260809 02:25:59.110762 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 30785
2026-08-09T02:25:59Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (797 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (127 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (126 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:25:59 dist-test-slave-68xk krb5kdc[30947](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:25:59 dist-test-slave-68xk krb5kdc[30947](info): set up 2 sockets
Aug 09 02:25:59 dist-test-slave-68xk krb5kdc[30947](info): commencing operation
krb5kdc: starting...
W20260809 02:26:00.602025 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:26:00 dist-test-slave-68xk krb5kdc[30947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:26:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:26:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:26:00.737872 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:42033
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:45213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:42033
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:00.860647 30967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:00.861001 30967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:00.861090 30967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:00.865397 30967 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:26:00.865496 30967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:00.865535 30967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:00.865592 30967 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:26:00.865626 30967 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:26:00.870954 30967 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:45213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:42033
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:42033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:00.872048 30967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:00.873093 30967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:00.882122 30987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:00.882196 30980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:00.882483 30967 server_base.cc:1034] running on GCE node
W20260809 02:26:00.882164 30978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:00.883152 30967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:00.884366 30967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:00.885586 30967 hybrid_clock.cc:648] HybridClock initialized: now 1786242360885564 us; error 36 us; skew 500 ppm
Aug 09 02:26:00 dist-test-slave-68xk krb5kdc[30947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242360, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:00.888688 30967 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:26:00.889634 30967 webserver.cc:460] Webserver started at http://127.21.214.190:34723/ using document root <none> and password file <none>
I20260809 02:26:00.890187 30967 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:00.890251 30967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:00.890487 30967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:00.892567 30967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "c5e4b32772744cf99cc954809594f41d"
format_stamp: "Formatted at 2026-08-09 02:26:00 on dist-test-slave-68xk"
server_key: "bdcfd8cafc7055ddaadbb81f87e271ce"
server_key_iv: "a498f9350dadd9f30786f4ba2debb9dd"
server_key_version: "encryptionkey@0"
I20260809 02:26:00.893101 30967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "c5e4b32772744cf99cc954809594f41d"
format_stamp: "Formatted at 2026-08-09 02:26:00 on dist-test-slave-68xk"
server_key: "bdcfd8cafc7055ddaadbb81f87e271ce"
server_key_iv: "a498f9350dadd9f30786f4ba2debb9dd"
server_key_version: "encryptionkey@0"
I20260809 02:26:00.896943 30967 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 02:26:00.899497 30995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:00.900791 30967 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:26:00.901001 30967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "c5e4b32772744cf99cc954809594f41d"
format_stamp: "Formatted at 2026-08-09 02:26:00 on dist-test-slave-68xk"
server_key: "bdcfd8cafc7055ddaadbb81f87e271ce"
server_key_iv: "a498f9350dadd9f30786f4ba2debb9dd"
server_key_version: "encryptionkey@0"
I20260809 02:26:00.901153 30967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:00.936508 30967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:00.939653 30967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:00.939870 30967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:00.948182 30967 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:42033
I20260809 02:26:00.948210 31076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:42033 every 8 connection(s)
I20260809 02:26:00.949184 30967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:26:00.952214 31077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:00.955876 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 30967
I20260809 02:26:00.956019 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:26:00.956372 22362 external_mini_cluster.cc:1428] Setting key 97e5f2e0d65a7ff780f19235adc85be4
I20260809 02:26:00.959004 31077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d: Bootstrap starting.
I20260809 02:26:00.961370 31077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:00.962193 31077 log.cc:824] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:00.964579 31077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d: No bootstrap required, opened a new log
Aug 09 02:26:00 dist-test-slave-68xk krb5kdc[30947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:26:00.968899 31077 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4b32772744cf99cc954809594f41d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42033 } }
I20260809 02:26:00.969183 31077 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:00.969249 31077 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5e4b32772744cf99cc954809594f41d, State: Initialized, Role: FOLLOWER
I20260809 02:26:00.969698 31077 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4b32772744cf99cc954809594f41d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42033 } }
I20260809 02:26:00.969884 31077 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:26:00.969954 31077 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:26:00.970064 31077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:00.971318 31077 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4b32772744cf99cc954809594f41d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42033 } }
I20260809 02:26:00.971690 31077 leader_election.cc:302] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5e4b32772744cf99cc954809594f41d; no voters:
I20260809 02:26:00.972018 31077 leader_election.cc:288] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:26:00.972301 31085 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:00.972564 31081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:00.957958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44334 (local address 127.21.214.190:42033)
0809 02:26:00.958475 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:00.958491 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:00.958529 (+ 38us) server_negotiation.cc:407] Connection header received
0809 02:26:00.959226 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:00.959245 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:00.959566 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:00.959925 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:00.960783 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:00.961825 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:00.962856 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:00.963541 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:00.963715 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:00.966581 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:00.966588 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:00.966607 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:00.966639 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:00.969293 (+ 2654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:00.969794 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:00.969800 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:00.969806 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:00.969956 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:00.970261 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:00.970267 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:00.970272 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:00.970802 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:00.971004 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:00.971241 (+ 237us) server_negotiation.cc:299] Negotiation successful
0809 02:26:00.971546 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":134,"threads_started":1}
I20260809 02:26:00.972604 31085 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [term 1 LEADER]: Becoming Leader. State: Replica: c5e4b32772744cf99cc954809594f41d, State: Running, Role: LEADER
I20260809 02:26:00.973169 31085 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4b32772744cf99cc954809594f41d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42033 } }
I20260809 02:26:00.973280 31077 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:26:00.974812 31086 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5e4b32772744cf99cc954809594f41d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4b32772744cf99cc954809594f41d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42033 } } }
I20260809 02:26:00.974932 31086 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:00.975255 31088 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5e4b32772744cf99cc954809594f41d. Latest consensus state: current_term: 1 leader_uuid: "c5e4b32772744cf99cc954809594f41d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5e4b32772744cf99cc954809594f41d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42033 } } }
I20260809 02:26:00.975335 31088 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d [sys.catalog]: This master's current role is: LEADER
W20260809 02:26:00.977890 31106 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:26:00.977982 31106 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:26:00.978266 31102 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:26:00.979094 31102 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:26:00.984890 31102 catalog_manager.cc:1347] Generated new cluster ID: 26721193bcb348bea14c70e2cb761236
I20260809 02:26:00.984961 31102 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:26:01.012348 31102 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:26:01.013757 31102 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:26:01.023388 31102 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5e4b32772744cf99cc954809594f41d: Generated new TSK 0
I20260809 02:26:01.024046 31102 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:26:01.061487 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42033
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:45213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:01.191776 31115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:01.192049 31115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:01.192148 31115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:01.196331 31115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:01.196408 31115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:01.196491 31115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:26:01.201707 31115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:45213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:01.202742 31115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:01.203734 31115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:01.213526 31124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:01.213518 31122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:01.213757 31121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:01.213820 31115 server_base.cc:1034] running on GCE node
I20260809 02:26:01.214313 31115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:01.215009 31115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:01.216212 31115 hybrid_clock.cc:648] HybridClock initialized: now 1786242361216192 us; error 36 us; skew 500 ppm
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:01.219101 31115 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:26:01.219986 31115 webserver.cc:460] Webserver started at http://127.21.214.129:33031/ using document root <none> and password file <none>
I20260809 02:26:01.220491 31115 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:01.220551 31115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:01.220718 31115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:01.222733 31115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "9ac796d7ce3545ce8f849f7ac746e377"
format_stamp: "Formatted at 2026-08-09 02:26:01 on dist-test-slave-68xk"
server_key: "35df928d25412d143ecf526a2fcb5d8c"
server_key_iv: "88a48b08e6684b3fa84a87fa956367f6"
server_key_version: "encryptionkey@0"
I20260809 02:26:01.223243 31115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "9ac796d7ce3545ce8f849f7ac746e377"
format_stamp: "Formatted at 2026-08-09 02:26:01 on dist-test-slave-68xk"
server_key: "35df928d25412d143ecf526a2fcb5d8c"
server_key_iv: "88a48b08e6684b3fa84a87fa956367f6"
server_key_version: "encryptionkey@0"
I20260809 02:26:01.226871 31115 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:26:01.229302 31136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:01.230556 31115 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:26:01.230690 31115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "9ac796d7ce3545ce8f849f7ac746e377"
format_stamp: "Formatted at 2026-08-09 02:26:01 on dist-test-slave-68xk"
server_key: "35df928d25412d143ecf526a2fcb5d8c"
server_key_iv: "88a48b08e6684b3fa84a87fa956367f6"
server_key_version: "encryptionkey@0"
I20260809 02:26:01.230794 31115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:01.259591 31115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:01.262919 31115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:01.263134 31115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:01.263769 31115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:01.264624 31115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:01.264672 31115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:01.264746 31115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:01.264778 31115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:01.275249 31115 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:41425
I20260809 02:26:01.275353 31311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:41425 every 8 connection(s)
I20260809 02:26:01.276387 31115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:26:01.279328 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 31115
I20260809 02:26:01.279467 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:26:01.279824 22362 external_mini_cluster.cc:1428] Setting key 1ff5b8a70f6b073e14e5784005e177a6
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:26:01.292114 31081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:01.278329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:34429 (local address 127.21.214.190:42033)
0809 02:26:01.278544 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:01.278549 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:01.279665 (+ 1116us) server_negotiation.cc:407] Connection header received
0809 02:26:01.281107 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:01.281111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:01.281165 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:01.281230 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:01.282583 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.283117 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.284289 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.284526 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.284639 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:01.287780 (+ 3141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:01.287787 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:01.287792 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:01.287827 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:01.289681 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:01.290372 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:01.290376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:01.290378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:01.290501 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:01.290928 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:01.290932 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:01.290935 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:01.291177 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:01.291285 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:01.291869 (+ 584us) server_negotiation.cc:299] Negotiation successful
0809 02:26:01.291986 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260809 02:26:01.293237 31318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:01.278898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:42033 (local address 127.21.214.129:34429)
0809 02:26:01.279485 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:01.279545 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:01.280897 (+ 1352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:01.281422 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:01.281429 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:01.281794 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:01.282322 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:01.282336 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.283248 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.283252 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:01.284155 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:01.284164 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.284683 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.284687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:01.284931 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:01.285642 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:01.285668 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:01.287598 (+ 1930us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:01.289825 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:01.289830 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:01.289843 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:01.290242 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:01.290636 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:01.290639 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:01.290640 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:01.290795 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:01.291287 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:01.291292 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:01.291613 (+ 321us) client_negotiation.cc:769] Sending connection context
0809 02:26:01.291785 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 02:26:01.292073 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":180,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
I20260809 02:26:01.294711 31312 heartbeater.cc:347] Connected to a master server at 127.21.214.190:42033
I20260809 02:26:01.294970 31312 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:01.295477 31312 heartbeater.cc:511] Master 127.21.214.190:42033 requested a full tablet report, sending...
I20260809 02:26:01.297165 31016 ts_manager.cc:194] Registered new tserver with Master: 9ac796d7ce3545ce8f849f7ac746e377 (127.21.214.129:41425)
I20260809 02:26:01.298478 31016 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:34429
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:26:01.314271 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42033
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:45213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:01.427031 31323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:01.427301 31323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:01.427376 31323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:01.431368 31323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:01.431445 31323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:01.431531 31323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:26:01.436787 31323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:45213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:01.437950 31323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:01.439005 31323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:01.449395 31334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:01.449385 31337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:01.449406 31335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:01.449767 31323 server_base.cc:1034] running on GCE node
I20260809 02:26:01.450194 31323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:01.450896 31323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:01.452105 31323 hybrid_clock.cc:648] HybridClock initialized: now 1786242361452077 us; error 37 us; skew 500 ppm
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:01.455063 31323 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:26:01.455950 31323 webserver.cc:460] Webserver started at http://127.21.214.130:45143/ using document root <none> and password file <none>
I20260809 02:26:01.456523 31323 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:01.456619 31323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:01.456857 31323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:01.458979 31323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "99dba92fe77340db840ffc6d69f82af3"
format_stamp: "Formatted at 2026-08-09 02:26:01 on dist-test-slave-68xk"
server_key: "df5f9342ccbf47e9ff0e2b843543b6ce"
server_key_iv: "6153490cc15da72186a30399fb9847c5"
server_key_version: "encryptionkey@0"
I20260809 02:26:01.459568 31323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "99dba92fe77340db840ffc6d69f82af3"
format_stamp: "Formatted at 2026-08-09 02:26:01 on dist-test-slave-68xk"
server_key: "df5f9342ccbf47e9ff0e2b843543b6ce"
server_key_iv: "6153490cc15da72186a30399fb9847c5"
server_key_version: "encryptionkey@0"
I20260809 02:26:01.463508 31323 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:26:01.466019 31347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:01.467404 31323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:26:01.467564 31323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "99dba92fe77340db840ffc6d69f82af3"
format_stamp: "Formatted at 2026-08-09 02:26:01 on dist-test-slave-68xk"
server_key: "df5f9342ccbf47e9ff0e2b843543b6ce"
server_key_iv: "6153490cc15da72186a30399fb9847c5"
server_key_version: "encryptionkey@0"
I20260809 02:26:01.467682 31323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:01.480816 31323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:01.484030 31323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:01.484237 31323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:01.484833 31323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:01.485674 31323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:01.485754 31323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:01.485847 31323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:01.485899 31323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:01.495558 31323 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:34353
I20260809 02:26:01.495581 31517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:34353 every 8 connection(s)
I20260809 02:26:01.496811 31323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:26:01.501817 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 31323
I20260809 02:26:01.501950 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:26:01.502249 22362 external_mini_cluster.cc:1428] Setting key f575b968e6956dc3d52401ae1f699ce4
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:26:01.512065 31081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:01.498740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:40617 (local address 127.21.214.190:42033)
0809 02:26:01.498888 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:01.498892 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:01.499809 (+ 917us) server_negotiation.cc:407] Connection header received
0809 02:26:01.501154 (+ 1345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:01.501157 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:01.501210 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:01.501291 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:01.502703 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.503335 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.504631 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.505066 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.505199 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:01.508317 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:01.508320 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:01.508323 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:01.508356 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:01.509881 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:01.510479 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:01.510484 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:01.510488 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:01.510581 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:01.510957 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:01.510960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:01.510962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:01.511158 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:01.511275 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:01.511771 (+ 496us) server_negotiation.cc:299] Negotiation successful
0809 02:26:01.511899 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:26:01.512889 31521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:01.499143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:42033 (local address 127.21.214.130:40617)
0809 02:26:01.499615 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:01.499683 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:01.500926 (+ 1243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:01.501461 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:01.501467 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:01.501869 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:01.502539 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:01.502556 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.503475 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.503482 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:01.504458 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:01.504468 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.505268 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.505271 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:01.505415 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:01.506118 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:01.506192 (+ 74us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:01.508133 (+ 1941us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:01.510016 (+ 1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:01.510022 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:01.510043 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:01.510342 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:01.510693 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:01.510697 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:01.510699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:01.510844 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:01.511275 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:01.511283 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:01.511530 (+ 247us) client_negotiation.cc:769] Sending connection context
0809 02:26:01.511725 (+ 195us) client_negotiation.cc:240] Negotiation successful
0809 02:26:01.512065 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":121,"threads_started":1}
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
I20260809 02:26:01.514101 31518 heartbeater.cc:347] Connected to a master server at 127.21.214.190:42033
I20260809 02:26:01.514348 31518 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:01.514868 31518 heartbeater.cc:511] Master 127.21.214.190:42033 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
I20260809 02:26:01.516008 31016 ts_manager.cc:194] Registered new tserver with Master: 99dba92fe77340db840ffc6d69f82af3 (127.21.214.130:34353)
I20260809 02:26:01.516645 31016 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:40617
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:26:01.534111 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42033
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:45213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:01.653543 31525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:01.653784 31525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:01.653826 31525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:01.657830 31525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:01.657886 31525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:01.657943 31525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:26:01.663219 31525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:45213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42033
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:01.664161 31525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:01.665145 31525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:01.674916 31530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:01.674945 31531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:01.674909 31533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:01.675182 31525 server_base.cc:1034] running on GCE node
I20260809 02:26:01.675740 31525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:01.676402 31525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:01.677572 31525 hybrid_clock.cc:648] HybridClock initialized: now 1786242361677555 us; error 26 us; skew 500 ppm
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:01.680480 31525 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:26:01.681365 31525 webserver.cc:460] Webserver started at http://127.21.214.131:46657/ using document root <none> and password file <none>
I20260809 02:26:01.681887 31525 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:01.681948 31525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:01.682113 31525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:01.684187 31525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "7402b72526db4490ba56e5d6bf46badd"
format_stamp: "Formatted at 2026-08-09 02:26:01 on dist-test-slave-68xk"
server_key: "f3d1a88cc09556ffdb2f5fa87a902be4"
server_key_iv: "20301661162e7e7b8a57168a27b56659"
server_key_version: "encryptionkey@0"
I20260809 02:26:01.684710 31525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "7402b72526db4490ba56e5d6bf46badd"
format_stamp: "Formatted at 2026-08-09 02:26:01 on dist-test-slave-68xk"
server_key: "f3d1a88cc09556ffdb2f5fa87a902be4"
server_key_iv: "20301661162e7e7b8a57168a27b56659"
server_key_version: "encryptionkey@0"
I20260809 02:26:01.688470 31525 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:26:01.690920 31542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:01.692260 31525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:26:01.692394 31525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "7402b72526db4490ba56e5d6bf46badd"
format_stamp: "Formatted at 2026-08-09 02:26:01 on dist-test-slave-68xk"
server_key: "f3d1a88cc09556ffdb2f5fa87a902be4"
server_key_iv: "20301661162e7e7b8a57168a27b56659"
server_key_version: "encryptionkey@0"
I20260809 02:26:01.692528 31525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:01.703910 31525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:01.707144 31525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:01.707301 31525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:01.707798 31525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:01.708542 31525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:01.708590 31525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:01.708626 31525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:01.708642 31525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:01.717895 31525 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:39817
I20260809 02:26:01.717975 31703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:39817 every 8 connection(s)
I20260809 02:26:01.719009 31525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:26:01.721330 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 31525
I20260809 02:26:01.721473 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:26:01.721800 22362 external_mini_cluster.cc:1428] Setting key d9fb82a6eabf7cd5f105758250ba01ce
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:26:01.734584 31081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:01.721006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:36757 (local address 127.21.214.190:42033)
0809 02:26:01.721186 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:01.721191 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:01.722102 (+ 911us) server_negotiation.cc:407] Connection header received
0809 02:26:01.724168 (+ 2066us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:01.724171 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:01.724230 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:01.724306 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:01.725551 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.726096 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.727321 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.727546 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.727650 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:01.730743 (+ 3093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:01.730746 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:01.730748 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:01.730773 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:01.732319 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:01.732847 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:01.732850 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:01.732851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:01.732930 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:01.733353 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:01.733355 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:01.733357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:01.733612 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:01.733701 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:01.734266 (+ 565us) server_negotiation.cc:299] Negotiation successful
0809 02:26:01.734445 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 02:26:01.735699 31706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:01.721363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:42033 (local address 127.21.214.131:36757)
0809 02:26:01.721920 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:01.721974 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:01.723920 (+ 1946us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:01.724506 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:01.724513 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:01.724894 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:01.725409 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:01.725423 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.726232 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.726235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:01.727197 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:01.727209 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.727718 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.727722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:01.727861 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:01.728592 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:01.728608 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:01.730550 (+ 1942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:01.732441 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:01.732446 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:01.732460 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:01.732741 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:01.733013 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:01.733016 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:01.733017 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:01.733204 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:01.733744 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:01.733750 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:01.733985 (+ 235us) client_negotiation.cc:769] Sending connection context
0809 02:26:01.734197 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 02:26:01.734601 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":151,"threads_started":1}
I20260809 02:26:01.737071 31704 heartbeater.cc:347] Connected to a master server at 127.21.214.190:42033
I20260809 02:26:01.737339 31704 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:01.737877 31704 heartbeater.cc:511] Master 127.21.214.190:42033 requested a full tablet report, sending...
I20260809 02:26:01.739075 31016 ts_manager.cc:194] Registered new tserver with Master: 7402b72526db4490ba56e5d6bf46badd (127.21.214.131:39817)
I20260809 02:26:01.739804 31016 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:36757
I20260809 02:26:01.748272 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/test-admin.keytab.
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:01.767426 22362 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 02:26:01.770282 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:01.768915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42620 (local address 127.21.214.129:41425)
0809 02:26:01.769213 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:01.769229 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:01.769254 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:26:01.769307 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:01.769312 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:01.769496 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:01.769617 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:01.770100 (+ 483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42620: BlockingRecv error: recv got EOF from 127.0.0.1:42620 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":93,"threads_started":1}
W20260809 02:26:01.770882 22362 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/krb5cc)
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:01.772001 22362 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:01.773213 22362 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.129@KRBTEST.COM
I20260809 02:26:01.783921 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:01.774255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42628 (local address 127.21.214.129:41425)
0809 02:26:01.774376 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:01.774382 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:01.774558 (+ 176us) server_negotiation.cc:407] Connection header received
0809 02:26:01.774671 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:01.774673 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:01.774714 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:01.774779 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:01.775293 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.776154 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.776998 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.777368 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.777510 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:01.779923 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:01.779932 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:01.779944 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:01.779967 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:01.781723 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:01.782216 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:01.782222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:01.782224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:01.782313 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:01.782845 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:01.782848 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:01.782850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:01.783136 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:01.783322 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:01.783639 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 02:26:01.783787 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 02:26:01.788301 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:01.787211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42642 (local address 127.21.214.129:41425)
0809 02:26:01.787377 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:01.787381 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:01.787501 (+ 120us) server_negotiation.cc:407] Connection header received
0809 02:26:01.787646 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:01.787649 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:01.787697 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:01.787780 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:01.788196 (+ 416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42642: BlockingRecv error: recv got EOF from 127.0.0.1:42642 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260809 02:26:01.788436 22362 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/krb5cc' of type FILE
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:01.789557 22362 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:01.790607 22362 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.129@KRBTEST.COM
I20260809 02:26:01.799744 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:01.791415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42650 (local address 127.21.214.129:41425)
0809 02:26:01.791570 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:01.791574 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:01.791589 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:26:01.791678 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:01.791681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:01.791717 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:01.791787 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:01.792260 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.792873 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.793766 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.794007 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.794162 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:01.796783 (+ 2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:01.796786 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:01.796788 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:01.796810 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:01.798177 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:01.798641 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:01.798644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:01.798646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:01.798730 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:01.798955 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:01.798957 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:01.798959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:01.799122 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:01.799248 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:01.799420 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 02:26:01.799543 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 02:26:01.802389 31714 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:01.801429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42654 (local address 127.21.214.129:41425)
0809 02:26:01.801565 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:01.801568 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:01.801624 (+ 56us) server_negotiation.cc:407] Connection header received
0809 02:26:01.801714 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:01.801716 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:01.801749 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:01.801811 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:01.802308 (+ 497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42654: BlockingRecv error: recv got EOF from 127.0.0.1:42654 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 02:26:01.802543 22362 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786242328272206-22362-0/krb5kdc/krb5cc' of type FILE
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:01.803619 22362 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:01.804540 22362 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[30947](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242361, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.129@KRBTEST.COM
I20260809 02:26:01.813561 31714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:01.805404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42656 (local address 127.21.214.129:41425)
0809 02:26:01.805528 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:01.805534 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:01.805617 (+ 83us) server_negotiation.cc:407] Connection header received
0809 02:26:01.805787 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:01.805794 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:01.805842 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:01.805933 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:01.806500 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.807047 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.807907 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:01.808165 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:01.808289 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:01.810660 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:01.810663 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:01.810665 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:01.810686 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:01.812075 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:01.812501 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:01.812503 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:01.812505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:01.812576 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:01.812861 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:01.812863 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:01.812864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:01.813005 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:01.813102 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:01.813374 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 02:26:01.813458 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:26:01.814605 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 31115
I20260809 02:26:01.828759 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 31323
I20260809 02:26:01.850796 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 31525
I20260809 02:26:01.865624 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 30967
2026-08-09T02:26:01Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2502 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[31731](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[31731](info): set up 2 sockets
Aug 09 02:26:01 dist-test-slave-68xk krb5kdc[31731](info): commencing operation
krb5kdc: starting...
W20260809 02:26:03.104996 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:26:03 dist-test-slave-68xk krb5kdc[31731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:26:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:26:03Z Disabled control of system clock
WARNING: no policy specified for oryx/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.190.keytab.
Entry for principal oryx/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.190.keytab.
I20260809 02:26:03.233294 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:44511
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.190.keytab
--principal=oryx/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:44511
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:03.349196 31749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:03.349466 31749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:03.349510 31749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:03.353958 31749 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:26:03.354012 31749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:03.354035 31749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:03.354053 31749 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:26:03.354072 31749 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:26:03.359838 31749 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:44511
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.190.keytab
--principal=oryx/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:44511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:03.360775 31749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:03.361735 31749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:03.370471 31755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:03.370530 31757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:03.370517 31749 server_base.cc:1034] running on GCE node
W20260809 02:26:03.370548 31760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:03.371248 31749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:03.372344 31749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:03.373522 31749 hybrid_clock.cc:648] HybridClock initialized: now 1786242363373496 us; error 37 us; skew 500 ppm
Aug 09 02:26:03 dist-test-slave-68xk krb5kdc[31731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242363, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:03.380390 31749 init.cc:377] Logged in from keytab as oryx/127.21.214.190@KRBTEST.COM (short username oryx)
I20260809 02:26:03.381368 31749 webserver.cc:460] Webserver started at http://127.21.214.190:42817/ using document root <none> and password file <none>
I20260809 02:26:03.381949 31749 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:03.382016 31749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:03.382195 31749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:03.384541 31749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "3eedaf8b154b4549842034052633030d"
format_stamp: "Formatted at 2026-08-09 02:26:03 on dist-test-slave-68xk"
server_key: "08a9f063a7f446aedc55de74ad394503"
server_key_iv: "f58c8f7398d97f09e2ed8fc9f089709a"
server_key_version: "encryptionkey@0"
I20260809 02:26:03.385138 31749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "3eedaf8b154b4549842034052633030d"
format_stamp: "Formatted at 2026-08-09 02:26:03 on dist-test-slave-68xk"
server_key: "08a9f063a7f446aedc55de74ad394503"
server_key_iv: "f58c8f7398d97f09e2ed8fc9f089709a"
server_key_version: "encryptionkey@0"
I20260809 02:26:03.389251 31749 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 02:26:03.391780 31772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:03.393033 31749 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:26:03.393178 31749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "3eedaf8b154b4549842034052633030d"
format_stamp: "Formatted at 2026-08-09 02:26:03 on dist-test-slave-68xk"
server_key: "08a9f063a7f446aedc55de74ad394503"
server_key_iv: "f58c8f7398d97f09e2ed8fc9f089709a"
server_key_version: "encryptionkey@0"
I20260809 02:26:03.393286 31749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:03.407140 31749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:03.410152 31749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:03.410367 31749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:03.417466 31749 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:44511
I20260809 02:26:03.417795 31861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:44511 every 8 connection(s)
I20260809 02:26:03.418497 31749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:26:03.420055 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 31749
I20260809 02:26:03.420230 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:26:03.420531 22362 external_mini_cluster.cc:1428] Setting key 2283da498dde6c84f67ff45e87136f29
I20260809 02:26:03.421571 31862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:03.428521 31862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d: Bootstrap starting.
Aug 09 02:26:03 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
I20260809 02:26:03.431200 31862 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:03.432199 31862 log.cc:824] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:03.434476 31862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d: No bootstrap required, opened a new log
I20260809 02:26:03.436105 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:03.421968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39494 (local address 127.21.214.190:44511)
0809 02:26:03.422385 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:03.422403 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:03.422482 (+ 79us) server_negotiation.cc:407] Connection header received
0809 02:26:03.423334 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:03.423356 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:03.423769 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:03.424135 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:03.424883 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:03.426393 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:03.427374 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:03.428061 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:03.428227 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:03.431120 (+ 2893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:03.431126 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:03.431145 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:03.431179 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:03.433104 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:03.433596 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:03.433601 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:03.433606 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:03.433738 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:03.434035 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:03.434038 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:03.434039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:03.434504 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:03.434764 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:03.435018 (+ 254us) server_negotiation.cc:299] Negotiation successful
0809 02:26:03.435353 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":104,"threads_started":1}
I20260809 02:26:03.438068 31862 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } }
I20260809 02:26:03.438340 31862 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:03.438454 31862 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eedaf8b154b4549842034052633030d, State: Initialized, Role: FOLLOWER
I20260809 02:26:03.438854 31862 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } }
I20260809 02:26:03.438972 31862 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:26:03.439028 31862 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:26:03.439098 31862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:03.439952 31862 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } }
I20260809 02:26:03.440243 31862 leader_election.cc:302] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3eedaf8b154b4549842034052633030d; no voters:
I20260809 02:26:03.440500 31862 leader_election.cc:288] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:26:03.440642 31868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:03.440913 31868 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [term 1 LEADER]: Becoming Leader. State: Replica: 3eedaf8b154b4549842034052633030d, State: Running, Role: LEADER
I20260809 02:26:03.441296 31868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } }
I20260809 02:26:03.441717 31862 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:26:03.443222 31870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } }
I20260809 02:26:03.443214 31872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eedaf8b154b4549842034052633030d. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } }
I20260809 02:26:03.443373 31872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:03.443373 31870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:03.443881 31884 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:26:03.447149 31884 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:26:03.452770 31884 catalog_manager.cc:1347] Generated new cluster ID: eb48c3c31dc54750820198d28737ad6b
I20260809 02:26:03.452841 31884 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:26:03.466455 31884 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:26:03.467394 31884 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:26:03.474862 31884 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d: Generated new TSK 0
I20260809 02:26:03.475554 31884 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab.
Entry for principal oryx/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab.
I20260809 02:26:03.514264 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44511
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab
--principal=oryx/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:03.628810 31897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:03.629096 31897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:03.629181 31897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:03.633201 31897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:03.633288 31897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:03.633378 31897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:26:03.638564 31897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab
--principal=oryx/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:03.639612 31897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:03.640640 31897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:03.650532 31906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:03.650542 31908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:03.650561 31910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:03.650868 31897 server_base.cc:1034] running on GCE node
I20260809 02:26:03.651294 31897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:03.652053 31897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:03.653318 31897 hybrid_clock.cc:648] HybridClock initialized: now 1786242363653301 us; error 32 us; skew 500 ppm
Aug 09 02:26:03 dist-test-slave-68xk krb5kdc[31731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242363, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:03.656198 31897 init.cc:377] Logged in from keytab as oryx/127.21.214.129@KRBTEST.COM (short username oryx)
I20260809 02:26:03.657083 31897 webserver.cc:460] Webserver started at http://127.21.214.129:35499/ using document root <none> and password file <none>
I20260809 02:26:03.657639 31897 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:03.657730 31897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:03.657960 31897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:03.660003 31897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "663a460229954475b4b523e589106efc"
format_stamp: "Formatted at 2026-08-09 02:26:03 on dist-test-slave-68xk"
server_key: "563aef5cbe81defca0d0914aefa6f6ab"
server_key_iv: "c42cc820019c38debce5aa1700f91d86"
server_key_version: "encryptionkey@0"
I20260809 02:26:03.660576 31897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "663a460229954475b4b523e589106efc"
format_stamp: "Formatted at 2026-08-09 02:26:03 on dist-test-slave-68xk"
server_key: "563aef5cbe81defca0d0914aefa6f6ab"
server_key_iv: "c42cc820019c38debce5aa1700f91d86"
server_key_version: "encryptionkey@0"
I20260809 02:26:03.664309 31897 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260809 02:26:03.666949 31917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:03.668241 31897 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:26:03.668395 31897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "663a460229954475b4b523e589106efc"
format_stamp: "Formatted at 2026-08-09 02:26:03 on dist-test-slave-68xk"
server_key: "563aef5cbe81defca0d0914aefa6f6ab"
server_key_iv: "c42cc820019c38debce5aa1700f91d86"
server_key_version: "encryptionkey@0"
I20260809 02:26:03.668516 31897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:03.679430 31897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:03.682853 31897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:03.683082 31897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:03.683693 31897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:03.684540 31897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:03.684615 31897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:03.684701 31897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:03.684751 31897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:03.694809 31897 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:40687
I20260809 02:26:03.694864 32095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:40687 every 8 connection(s)
I20260809 02:26:03.695789 31897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:26:03.701647 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 31897
I20260809 02:26:03.701779 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:26:03.702088 22362 external_mini_cluster.cc:1428] Setting key 7c10c57694abf4d68afabb60c58cdc81
Aug 09 02:26:03 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242363, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
I20260809 02:26:03.711759 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:03.697858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:41349 (local address 127.21.214.190:44511)
0809 02:26:03.698028 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:03.698032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:03.699002 (+ 970us) server_negotiation.cc:407] Connection header received
0809 02:26:03.700443 (+ 1441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:03.700447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:03.700502 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:03.700586 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:03.701946 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:03.702650 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:03.704152 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:03.704386 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:03.704481 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:03.707793 (+ 3312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:03.707796 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:03.707798 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:03.707821 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:03.709328 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:03.710016 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:03.710019 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:03.710020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:03.710113 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:03.710564 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:03.710567 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:03.710568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:03.710750 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:03.710832 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:03.711503 (+ 671us) server_negotiation.cc:299] Negotiation successful
0809 02:26:03.711636 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:26:03.712900 32100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:03.698314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.129:41349)
0809 02:26:03.698852 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:03.698896 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:03.700230 (+ 1334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:03.700751 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:03.700758 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:03.701104 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:03.701748 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:03.701771 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:03.702787 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:03.702790 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:03.703996 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:03.704007 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:03.704554 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:03.704560 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:03.704804 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:03.705510 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:03.705536 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:03.707602 (+ 2066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:03.709450 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:03.709458 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:03.709476 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:03.709876 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:03.710225 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:03.710230 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:03.710233 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:03.710456 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:03.710866 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:03.710876 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:03.711204 (+ 328us) client_negotiation.cc:769] Sending connection context
0809 02:26:03.711423 (+ 219us) client_negotiation.cc:240] Negotiation successful
0809 02:26:03.711789 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":151,"threads_started":1}
WARNING: no policy specified for oryx/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:26:03.714278 32098 heartbeater.cc:347] Connected to a master server at 127.21.214.190:44511
I20260809 02:26:03.714597 32098 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:03.715107 32098 heartbeater.cc:511] Master 127.21.214.190:44511 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.214.130@KRBTEST.COM" created.
I20260809 02:26:03.716899 31797 ts_manager.cc:194] Registered new tserver with Master: 663a460229954475b4b523e589106efc (127.21.214.129:40687)
I20260809 02:26:03.718751 31797 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:41349
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab.
Entry for principal oryx/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab.
I20260809 02:26:03.733871 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44511
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab
--principal=oryx/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:03.849627 32103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:03.849972 32103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:03.850020 32103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:03.854092 32103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:03.854154 32103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:03.854214 32103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:26:03.859452 32103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab
--principal=oryx/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:03.860536 32103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:03.861522 32103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:03.871141 32111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:03.871177 32112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:03.871214 32114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:03.871521 32103 server_base.cc:1034] running on GCE node
I20260809 02:26:03.871969 32103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:03.872689 32103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:03.873862 32103 hybrid_clock.cc:648] HybridClock initialized: now 1786242363873846 us; error 26 us; skew 500 ppm
Aug 09 02:26:03 dist-test-slave-68xk krb5kdc[31731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242363, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:03.876714 32103 init.cc:377] Logged in from keytab as oryx/127.21.214.130@KRBTEST.COM (short username oryx)
I20260809 02:26:03.877878 32103 webserver.cc:460] Webserver started at http://127.21.214.130:37791/ using document root <none> and password file <none>
I20260809 02:26:03.878587 32103 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:03.878690 32103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:03.878929 32103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:03.881042 32103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "f20e3d7982964ac9be3d5e3c1866bfe1"
format_stamp: "Formatted at 2026-08-09 02:26:03 on dist-test-slave-68xk"
server_key: "8360411adb939c8442335ac02d2a5087"
server_key_iv: "366bac2bd66633e6588955fcebb8646e"
server_key_version: "encryptionkey@0"
I20260809 02:26:03.881635 32103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "f20e3d7982964ac9be3d5e3c1866bfe1"
format_stamp: "Formatted at 2026-08-09 02:26:03 on dist-test-slave-68xk"
server_key: "8360411adb939c8442335ac02d2a5087"
server_key_iv: "366bac2bd66633e6588955fcebb8646e"
server_key_version: "encryptionkey@0"
I20260809 02:26:03.885850 32103 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 02:26:03.888770 32124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:03.890113 32103 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:26:03.890306 32103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "f20e3d7982964ac9be3d5e3c1866bfe1"
format_stamp: "Formatted at 2026-08-09 02:26:03 on dist-test-slave-68xk"
server_key: "8360411adb939c8442335ac02d2a5087"
server_key_iv: "366bac2bd66633e6588955fcebb8646e"
server_key_version: "encryptionkey@0"
I20260809 02:26:03.890470 32103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:03.958364 32103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:03.961864 32103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:03.962100 32103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:03.962853 32103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:03.963773 32103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:03.963852 32103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:03.963934 32103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:03.963989 32103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:03.974494 32103 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:45379
I20260809 02:26:03.974524 32285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:45379 every 8 connection(s)
I20260809 02:26:03.975548 32103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:26:03.982214 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 32103
I20260809 02:26:03.982331 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:26:03.982671 22362 external_mini_cluster.cc:1428] Setting key a94a6b30f1b9b6ae681970ea07007aad
Aug 09 02:26:03 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242363, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
I20260809 02:26:03.989965 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:03.977439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:38535 (local address 127.21.214.190:44511)
0809 02:26:03.977599 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:03.977603 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:03.978601 (+ 998us) server_negotiation.cc:407] Connection header received
0809 02:26:03.980009 (+ 1408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:03.980012 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:03.980086 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:03.980173 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:03.981356 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:03.981908 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:03.983354 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:03.983600 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:03.983715 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:03.986351 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:03.986355 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:03.986358 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:03.986392 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:03.987920 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:03.988442 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:03.988447 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:03.988449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:03.988533 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:03.988882 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:03.988887 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:03.988889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:03.989076 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:03.989184 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:03.989679 (+ 495us) server_negotiation.cc:299] Negotiation successful
0809 02:26:03.989803 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:26:03.990869 32289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:03.977827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.130:38535)
0809 02:26:03.978362 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:03.978406 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:03.979790 (+ 1384us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:03.980361 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:03.980368 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:03.980722 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:03.981198 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:03.981211 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:03.982072 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:03.982076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:03.983218 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:03.983230 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:03.983758 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:03.983762 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:03.983975 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:03.984658 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:03.984674 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:03.986184 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:03.988044 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:03.988050 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:03.988073 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:03.988334 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:03.988636 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:03.988639 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:03.988641 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:03.988783 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:03.989183 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:03.989190 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:03.989442 (+ 252us) client_negotiation.cc:769] Sending connection context
0809 02:26:03.989636 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 02:26:03.989973 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":127,"threads_started":1}
I20260809 02:26:03.992239 32287 heartbeater.cc:347] Connected to a master server at 127.21.214.190:44511
I20260809 02:26:03.992538 32287 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:03.993140 32287 heartbeater.cc:511] Master 127.21.214.190:44511 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.21.214.131@KRBTEST.COM; defaulting to no policy
I20260809 02:26:03.994531 31797 ts_manager.cc:194] Registered new tserver with Master: f20e3d7982964ac9be3d5e3c1866bfe1 (127.21.214.130:45379)
I20260809 02:26:03.995306 31797 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:38535
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab.
Entry for principal oryx/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab.
I20260809 02:26:04.013397 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44511
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab
--principal=oryx/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:04.150211 32293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:04.150559 32293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:04.150655 32293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:04.155123 32293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:04.155180 32293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:04.155306 32293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:26:04.161135 32293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab
--principal=oryx/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:04.162207 32293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:04.163411 32293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:04.173338 32303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:04.173321 32301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:04.173298 32300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:04.173599 32293 server_base.cc:1034] running on GCE node
I20260809 02:26:04.174111 32293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:04.174834 32293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:04.176038 32293 hybrid_clock.cc:648] HybridClock initialized: now 1786242364176022 us; error 37 us; skew 500 ppm
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242364, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:04.178965 32293 init.cc:377] Logged in from keytab as oryx/127.21.214.131@KRBTEST.COM (short username oryx)
I20260809 02:26:04.179880 32293 webserver.cc:460] Webserver started at http://127.21.214.131:38735/ using document root <none> and password file <none>
I20260809 02:26:04.180444 32293 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:04.180538 32293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:04.180778 32293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:04.182859 32293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "b8988bbb9ebf40029d49a50e95639df6"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "04f5f47a9c69910191df96b93b93ee94"
server_key_iv: "91399f806e9b482bc5d1342c48328dba"
server_key_version: "encryptionkey@0"
I20260809 02:26:04.183439 32293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "b8988bbb9ebf40029d49a50e95639df6"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "04f5f47a9c69910191df96b93b93ee94"
server_key_iv: "91399f806e9b482bc5d1342c48328dba"
server_key_version: "encryptionkey@0"
I20260809 02:26:04.187305 32293 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:26:04.189875 32316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:04.191205 32293 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:26:04.191372 32293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "b8988bbb9ebf40029d49a50e95639df6"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "04f5f47a9c69910191df96b93b93ee94"
server_key_iv: "91399f806e9b482bc5d1342c48328dba"
server_key_version: "encryptionkey@0"
I20260809 02:26:04.191484 32293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:04.205505 32293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:04.208695 32293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:04.208909 32293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:04.209496 32293 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:04.210351 32293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:04.210456 32293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:04.210549 32293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:04.210604 32293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:04.220117 32293 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:41855
I20260809 02:26:04.220237 32494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:41855 every 8 connection(s)
I20260809 02:26:04.221030 32293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:26:04.230276 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 32293
I20260809 02:26:04.230451 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:26:04.230782 22362 external_mini_cluster.cc:1428] Setting key 2edfde50b643bb2bbbf5bc9311b9c4be
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242364, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
I20260809 02:26:04.235405 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.222900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:49873 (local address 127.21.214.190:44511)
0809 02:26:04.223045 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.223049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.223870 (+ 821us) server_negotiation.cc:407] Connection header received
0809 02:26:04.225334 (+ 1464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.225337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.225395 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.225504 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.226731 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.227269 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.228433 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.228671 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.228791 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.231580 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.231584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.231586 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.231619 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.233428 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.233917 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.233919 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.233921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.234001 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.234332 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.234335 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.234336 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.234580 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.234667 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.235158 (+ 491us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.235286 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 02:26:04.236217 32497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.223274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.131:49873)
0809 02:26:04.223716 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.223758 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.225112 (+ 1354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.225685 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.225692 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.226030 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.226569 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.226585 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.227407 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.227411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.228296 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.228306 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.228834 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.228838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.229012 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.229557 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.229574 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.231456 (+ 1882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.233531 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.233535 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.233545 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.233804 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.234083 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.234086 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.234087 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.234241 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.234676 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.234681 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.234905 (+ 224us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.235065 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.235335 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":103,"threads_started":1}
I20260809 02:26:04.237305 32495 heartbeater.cc:347] Connected to a master server at 127.21.214.190:44511
I20260809 02:26:04.237557 32495 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:04.238039 32495 heartbeater.cc:511] Master 127.21.214.190:44511 requested a full tablet report, sending...
I20260809 02:26:04.239069 31797 ts_manager.cc:194] Registered new tserver with Master: b8988bbb9ebf40029d49a50e95639df6 (127.21.214.131:41855)
I20260809 02:26:04.239612 31797 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:49873
I20260809 02:26:04.244882 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.21.214.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.214.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.214.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.189.keytab.
Entry for principal oryx/127.21.214.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.189.keytab.
I20260809 02:26:04.274124 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.189:40483
--webserver_interface=127.21.214.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.189.keytab
--principal=oryx/127.21.214.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:44511,127.21.214.189:40483
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:04.389758 32500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:04.390022 32500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:04.390064 32500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:04.394344 32500 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:26:04.394457 32500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:04.394502 32500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:04.394527 32500 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:26:04.394549 32500 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:26:04.400178 32500 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:44511,127.21.214.189:40483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.189.keytab
--principal=oryx/127.21.214.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.189:40483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.214.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
W20260809 02:26:04.400382 32500 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.21.214.190:44511,127.21.214.189:40483'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 02:26:04.401255 32500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:04.402251 32500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:26:04.411180 32500 server_base.cc:1034] running on GCE node
W20260809 02:26:04.411108 32507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:04.411128 32509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:04.411111 32513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:04.411926 32500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:04.413228 32500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:04.414508 32500 hybrid_clock.cc:648] HybridClock initialized: now 1786242364414482 us; error 45 us; skew 500 ppm
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242364, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:04.417654 32500 init.cc:377] Logged in from keytab as oryx/127.21.214.189@KRBTEST.COM (short username oryx)
I20260809 02:26:04.418700 32500 webserver.cc:460] Webserver started at http://127.21.214.189:41511/ using document root <none> and password file <none>
I20260809 02:26:04.419293 32500 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:04.419391 32500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:04.419633 32500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:04.421759 32500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/data/instance:
uuid: "e20873ff3d1e4564ad945b14e17c51f3"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "2686da4c912dfb4d3101da06ecc6bcdc"
server_key_iv: "fd437051a5bdc8b68c4c56bc12118837"
server_key_version: "encryptionkey@0"
I20260809 02:26:04.422381 32500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/wal/instance:
uuid: "e20873ff3d1e4564ad945b14e17c51f3"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "2686da4c912dfb4d3101da06ecc6bcdc"
server_key_iv: "fd437051a5bdc8b68c4c56bc12118837"
server_key_version: "encryptionkey@0"
I20260809 02:26:04.426329 32500 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 02:26:04.428936 32524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:04.430315 32500 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:26:04.430493 32500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/wal
uuid: "e20873ff3d1e4564ad945b14e17c51f3"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "2686da4c912dfb4d3101da06ecc6bcdc"
server_key_iv: "fd437051a5bdc8b68c4c56bc12118837"
server_key_version: "encryptionkey@0"
I20260809 02:26:04.430621 32500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:04.454685 32500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:04.458207 32500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:04.458519 32500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:04.466114 32500 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.189:40483
I20260809 02:26:04.466125 32604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.189:40483 every 8 connection(s)
I20260809 02:26:04.467195 32500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/data/info.pb
I20260809 02:26:04.470492 32606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:04.471526 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 32500
I20260809 02:26:04.476418 32606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.214.189@KRBTEST.COM
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242364, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.189@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
I20260809 02:26:04.488083 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.473223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38128 (local address 127.21.214.189:40483)
0809 02:26:04.473784 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.473801 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.473842 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:26:04.474680 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.474702 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.475075 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.475451 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.476354 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.477546 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.478779 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.479419 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.479617 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.482510 (+ 2893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.482519 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.482533 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.482583 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.484479 (+ 1896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.485016 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.485025 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.485032 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.485195 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.485595 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.485599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.485600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.486171 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.486405 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.486731 (+ 326us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.487024 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":146,"threads_started":1}
I20260809 02:26:04.488339 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.478195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39496 (local address 127.21.214.190:44511)
0809 02:26:04.478354 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.478360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.478668 (+ 308us) server_negotiation.cc:407] Connection header received
0809 02:26:04.478863 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.478867 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.478924 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.479013 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.479706 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.480418 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.481436 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.481668 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.481758 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.484369 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.484375 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.484380 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.484413 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.486272 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.486887 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.486891 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.486893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.486986 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.487283 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.487286 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.487288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.487584 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.487689 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.488040 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.488183 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 02:26:04.488369 32610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.478101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:39496)
0809 02:26:04.478526 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.478577 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.478700 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.479070 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.479074 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.479419 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.479568 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.479574 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.480574 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.480577 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.481260 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.481273 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.481838 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.481842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.481980 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.482601 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.482614 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.484207 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.486379 (+ 2172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.486390 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.486396 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.486766 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.487093 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.487095 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.487097 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.487177 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.487695 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.487700 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.487819 (+ 119us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.487927 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.488066 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"spinlock_wait_cycles":1408,"thread_start_us":135,"threads_started":1}
I20260809 02:26:04.489595 32606 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242364, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.189@KRBTEST.COM for oryx/127.21.214.189@KRBTEST.COM
I20260809 02:26:04.498613 32610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.490149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40483 (local address 127.0.0.1:38136)
0809 02:26:04.490258 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.490273 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.490350 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.490654 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.490656 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.490790 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.490880 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.490885 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.492065 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.492067 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.492563 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.492571 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.493015 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.493018 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.493088 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.493483 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.493494 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.495061 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.496891 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.496894 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.496895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.497181 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.497462 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.497465 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.497468 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.497606 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.497978 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.497981 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.498079 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.498229 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.498379 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 02:26:04.498631 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.490310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38136 (local address 127.21.214.189:40483)
0809 02:26:04.490465 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.490470 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.490483 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:26:04.490514 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.490517 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.490558 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.490627 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.491014 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.491943 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.492675 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.492917 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.493003 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.495197 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.495200 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.495202 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.495222 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.496777 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.497282 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.497285 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.497286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.497357 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.497695 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.497697 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.497698 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.497870 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.497989 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.498277 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.498458 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":47}
I20260809 02:26:04.501734 32606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: Bootstrap starting.
I20260809 02:26:04.504158 32606 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:04.504920 32606 log.cc:824] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:04.506942 32606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: No bootstrap required, opened a new log
I20260809 02:26:04.509903 32606 raft_consensus.cc:348] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } }
I20260809 02:26:04.510092 32606 raft_consensus.cc:374] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:04.510156 32606 raft_consensus.cc:729] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e20873ff3d1e4564ad945b14e17c51f3, State: Initialized, Role: FOLLOWER
I20260809 02:26:04.510644 32606 consensus_queue.cc:260] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } }
I20260809 02:26:04.511183 32613 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } } }
I20260809 02:26:04.511309 32613 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:26:04.511886 32606 sys_catalog.cc:564] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 02:26:04.516716 32630 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:26:04.516814 32630 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:26:04.519495 32500 master_runner.cc:428] Detected that this master e20873ff3d1e4564ad945b14e17c51f3 is joining an existing cluster
I20260809 02:26:04.519593 32500 master_runner.cc:432] Initiating AddMaster RPC to add 127.21.214.189:40483
I20260809 02:26:04.531337 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.521941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39500 (local address 127.21.214.190:44511)
0809 02:26:04.522146 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.522152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.522529 (+ 377us) server_negotiation.cc:407] Connection header received
0809 02:26:04.522698 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.522703 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.522762 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.522853 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.523494 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.524315 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.525576 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.525892 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.526029 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.527517 (+ 1488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.527522 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.527525 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.527556 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.529410 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.529947 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.529951 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.529952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.530042 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.530387 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.530391 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.530393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.530632 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.530756 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.531047 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.531182 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:26:04.531665 32639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.521936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40483 (local address 127.0.0.1:38150)
0809 02:26:04.522483 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.522495 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.522637 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.522976 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.522979 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.523229 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.523342 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.523349 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.524173 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.524176 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.524861 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.524870 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.525378 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.525381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.525501 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.526960 (+ 1459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.526977 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.527517 (+ 540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.529804 (+ 2287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.529808 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.529810 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.530065 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.530444 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.530447 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.530449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.530533 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.530959 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.530962 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.531032 (+ 70us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.531381 (+ 349us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.531482 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":4,"spinlock_wait_cycles":768,"thread_start_us":117,"threads_started":1}
I20260809 02:26:04.531361 32638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.521901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:39500)
0809 02:26:04.522393 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.522411 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.522576 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.522885 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.522889 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.523169 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.523344 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.523355 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.524466 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.524469 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.525459 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.525470 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.526039 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.526043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.526146 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.526656 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.526678 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.527338 (+ 660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.529559 (+ 2221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.529563 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.529565 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.529833 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.530151 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.530157 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.530160 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.530278 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.530746 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.530749 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.530864 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.530986 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.531139 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"mutex_wait_us":51,"spinlock_wait_cycles":3200,"thread_start_us":118,"threads_started":1}
I20260809 02:26:04.532342 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.522348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38150 (local address 127.21.214.189:40483)
0809 02:26:04.522454 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.522458 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.522574 (+ 116us) server_negotiation.cc:407] Connection header received
0809 02:26:04.522744 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.522748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.522788 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.522867 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.523475 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.524021 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.524991 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.525243 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.525368 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.527692 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.527696 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.527699 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.527724 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.529686 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.530226 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.530230 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.530231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.530315 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.530633 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.530636 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.530637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.530836 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.530903 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.531174 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.531281 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":28,"spinlock_wait_cycles":3840}
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242363, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.190@KRBTEST.COM for oryx/127.21.214.189@KRBTEST.COM
I20260809 02:26:04.547432 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.536835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38160 (local address 127.21.214.189:40483)
0809 02:26:04.536953 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.536957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.537307 (+ 350us) server_negotiation.cc:407] Connection header received
0809 02:26:04.537499 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.537502 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.537551 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.537644 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.538249 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.539014 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.540007 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.540333 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.540441 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.543504 (+ 3063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.543512 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.543518 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.543554 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.545399 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.545953 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.545957 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.545959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.546045 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.546366 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.546371 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.546372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.546639 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.546757 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.547133 (+ 376us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.547259 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:26:04.547449 32640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.536791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40483 (local address 127.0.0.1:38160)
0809 02:26:04.537160 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.537223 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.537364 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.537691 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.537696 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.538027 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.538136 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.538142 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.539150 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.539154 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.539882 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.539893 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.540472 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.540476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.540605 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.541364 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.541382 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.543345 (+ 1963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.545538 (+ 2193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.545551 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.545558 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.545830 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.546156 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.546161 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.546163 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.546261 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.546758 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.546766 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.546899 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.547063 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.547271 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":115,"threads_started":1}
I20260809 02:26:04.549170 31797 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.21.214.189:40483: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3"
member_type: NON_VOTER
last_known_addr {
host: "127.21.214.189"
port: 40483
}
attrs {
promote: true
}
}
dest_uuid: "3eedaf8b154b4549842034052633030d"
cas_config_opid_index: -1
I20260809 02:26:04.550004 31797 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } }
I20260809 02:26:04.552289 32647 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER e20873ff3d1e4564ad945b14e17c51f3 (127.21.214.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } } }
I20260809 02:26:04.553007 32571 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 0 FOLLOWER]: Advancing to term 1
WARNING: no policy specified for oryx/127.21.214.188@KRBTEST.COM; defaulting to no policy
I20260809 02:26:04.553871 32647 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.21.214.189:40483
I20260809 02:26:04.554143 32647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } } }
I20260809 02:26:04.554246 32647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:04.554454 32500 master.cc:537] Master@127.21.214.189:40483 shutting down...
I20260809 02:26:04.554579 32571 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 FOLLOWER]: Refusing update from remote peer 3eedaf8b154b4549842034052633030d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 02:26:04.555335 32647 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.214.188@KRBTEST.COM" created.
W20260809 02:26:04.559358 31773 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260809 02:26:04.559510 32500 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:04.559819 32500 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:04.559953 32500 tablet_replica.cc:330] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: stopping tablet replica
W20260809 02:26:04.560343 31773 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d -> Peer e20873ff3d1e4564ad945b14e17c51f3 (127.21.214.189:40483): Couldn't send request to peer e20873ff3d1e4564ad945b14e17c51f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 02:26:04.575385 32500 master.cc:552] Master@127.21.214.189:40483 shutdown complete.
I20260809 02:26:04.575448 32500 master_runner.cc:305] Clearing existing system tablet
I20260809 02:26:04.575744 32500 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:04.575811 32500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.214.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.188.keytab.
Entry for principal oryx/127.21.214.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.188.keytab.
I20260809 02:26:04.577553 32500 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 02:26:04.578313 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.188:38955
--webserver_interface=127.21.214.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.188.keytab
--principal=oryx/127.21.214.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:44511,127.21.214.189:40483,127.21.214.188:38955
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:26:04.578455 32658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:04.578812 32500 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:04.578974 32500 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:26:04.579013 32500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/wal
uuid: "e20873ff3d1e4564ad945b14e17c51f3"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "2686da4c912dfb4d3101da06ecc6bcdc"
server_key_iv: "fd437051a5bdc8b68c4c56bc12118837"
server_key_version: "encryptionkey@0"
I20260809 02:26:04.581187 32500 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:04.583374 32500 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 02:26:04.583488 32500 log.cc:1196] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 02:26:04.583747 32500 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: Deleting consensus metadata
I20260809 02:26:04.583941 32500 master_runner.cc:315] Copying system tablet from 127.21.214.190:44511
I20260809 02:26:04.585165 32500 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: tablet copy: Beginning tablet copy session from remote peer at address 127.21.214.190:44511
I20260809 02:26:04.593573 32667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.585782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:39504)
0809 02:26:04.586112 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.586131 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.586273 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.586593 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.586596 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.586815 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.586924 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.586930 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.587730 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.587734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.588339 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.588348 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.588847 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.588851 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.588948 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.589630 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.589644 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.589982 (+ 338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.591983 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.591988 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.591990 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.592212 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.592504 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.592508 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.592510 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.592598 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.592986 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.592989 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.593096 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.593215 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.593365 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":88,"threads_started":1}
I20260809 02:26:04.593602 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.585844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39504 (local address 127.21.214.190:44511)
0809 02:26:04.585983 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.585989 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.586223 (+ 234us) server_negotiation.cc:407] Connection header received
0809 02:26:04.586389 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.586392 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.586472 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.586572 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.587054 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.587602 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.588469 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.588717 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.588829 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.590133 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.590136 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.590139 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.590167 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.591860 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.592317 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.592321 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.592323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.592408 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.592694 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.592698 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.592700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.592885 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.592994 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.593274 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.593465 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:26:04.594391 31832 tablet_copy_service.cc:140] P 3eedaf8b154b4549842034052633030d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e20873ff3d1e4564ad945b14e17c51f3 ({username='oryx', principal='oryx/127.21.214.189@KRBTEST.COM'} at 127.0.0.1:39504)
I20260809 02:26:04.594610 31832 tablet_copy_service.cc:161] P 3eedaf8b154b4549842034052633030d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e20873ff3d1e4564ad945b14e17c51f3 at {username='oryx', principal='oryx/127.21.214.189@KRBTEST.COM'} at 127.0.0.1:39504: session id = e20873ff3d1e4564ad945b14e17c51f3-00000000000000000000000000000000
I20260809 02:26:04.596575 31832 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 02:26:04.598532 32500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 02:26:04.600521 32500 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: tablet copy: Starting download of 0 data blocks...
I20260809 02:26:04.600745 32500 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: tablet copy: Starting download of 1 WAL segments...
I20260809 02:26:04.602458 32500 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 02:26:04.604130 31832 tablet_copy_service.cc:342] P 3eedaf8b154b4549842034052633030d: Request end of tablet copy session e20873ff3d1e4564ad945b14e17c51f3-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.21.214.189@KRBTEST.COM'} at 127.0.0.1:39504
I20260809 02:26:04.604264 31832 tablet_copy_service.cc:433] P 3eedaf8b154b4549842034052633030d: ending tablet copy session e20873ff3d1e4564ad945b14e17c51f3-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e20873ff3d1e4564ad945b14e17c51f3
I20260809 02:26:04.611397 32500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:04.613077 32675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:04.613077 32669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:04.613499 32500 server_base.cc:1034] running on GCE node
W20260809 02:26:04.613749 32671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:04.613958 32500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:04.614287 32500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:04.615429 32500 hybrid_clock.cc:648] HybridClock initialized: now 1786242364615437 us; error 43 us; skew 500 ppm
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242364, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:04.617003 32500 init.cc:377] Logged in from keytab as oryx/127.21.214.189@KRBTEST.COM (short username oryx)
I20260809 02:26:04.617484 32500 webserver.cc:460] Webserver started at http://127.21.214.189:34831/ using document root <none> and password file <none>
I20260809 02:26:04.617691 32500 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:04.617749 32500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:04.618901 32500 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:26:04.619831 32684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:04.620086 32500 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 02:26:04.620186 32500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/wal
uuid: "e20873ff3d1e4564ad945b14e17c51f3"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "2686da4c912dfb4d3101da06ecc6bcdc"
server_key_iv: "fd437051a5bdc8b68c4c56bc12118837"
server_key_version: "encryptionkey@0"
I20260809 02:26:04.620275 32500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:04.625952 32500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:04.627967 32500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:04.633359 32500 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.189:40483
I20260809 02:26:04.633457 32760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.189:40483 every 8 connection(s)
I20260809 02:26:04.633941 32500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-1/data/info.pb
I20260809 02:26:04.635589 32761 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:26:04.636426 32761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: Bootstrap starting.
I20260809 02:26:04.645431 32761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:26:04.645740 32761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: Bootstrap complete.
I20260809 02:26:04.646271 32761 raft_consensus.cc:348] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } }
I20260809 02:26:04.646413 32761 raft_consensus.cc:729] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e20873ff3d1e4564ad945b14e17c51f3, State: Initialized, Role: LEARNER
I20260809 02:26:04.646557 32761 consensus_queue.cc:260] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } }
I20260809 02:26:04.646912 32765 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } } }
I20260809 02:26:04.647075 32765 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: This master's current role is: LEARNER
I20260809 02:26:04.647092 32761 sys_catalog.cc:564] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:26:04.649930 317 catalog_manager.cc:1259] Loaded cluster ID: eb48c3c31dc54750820198d28737ad6b
I20260809 02:26:04.650030 317 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: loading cluster ID for follower catalog manager: success
I20260809 02:26:04.651886 317 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: acquiring CA information for follower catalog manager: success
I20260809 02:26:04.653155 317 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:26:04.721467 32098 heartbeater.cc:503] Master 127.21.214.190:44511 was elected leader, sending a full tablet report...
W20260809 02:26:04.730284 32659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:04.730610 32659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:04.730705 32659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:04.734661 32659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:26:04.734741 32659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:04.734778 32659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:04.734814 32659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:26:04.734856 32659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:26:04.740129 32659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:44511,127.21.214.189:40483,127.21.214.188:38955
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.188.keytab
--principal=oryx/127.21.214.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.188:38955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.214.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:04.741246 32659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:04.742311 32659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:04.751519 326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:04.751516 327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:04.751541 329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:04.751798 32659 server_base.cc:1034] running on GCE node
I20260809 02:26:04.752384 32659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:04.753643 32659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:04.754827 32659 hybrid_clock.cc:648] HybridClock initialized: now 1786242364754811 us; error 31 us; skew 500 ppm
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242364, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:04.757897 32659 init.cc:377] Logged in from keytab as oryx/127.21.214.188@KRBTEST.COM (short username oryx)
I20260809 02:26:04.759251 32659 webserver.cc:460] Webserver started at http://127.21.214.188:37183/ using document root <none> and password file <none>
I20260809 02:26:04.759876 32659 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:04.759979 32659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:04.760267 32659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:04.762494 32659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/data/instance:
uuid: "fe0634cb74da4dd1ae30ed10da3896ae"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "cc057b82ec57be2441da35280177866c"
server_key_iv: "e9bc9201668fd851c7112c90ae53b032"
server_key_version: "encryptionkey@0"
I20260809 02:26:04.763115 32659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/wal/instance:
uuid: "fe0634cb74da4dd1ae30ed10da3896ae"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "cc057b82ec57be2441da35280177866c"
server_key_iv: "e9bc9201668fd851c7112c90ae53b032"
server_key_version: "encryptionkey@0"
I20260809 02:26:04.767071 32659 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:26:04.769881 341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:04.771354 32659 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:26:04.771510 32659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/wal
uuid: "fe0634cb74da4dd1ae30ed10da3896ae"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "cc057b82ec57be2441da35280177866c"
server_key_iv: "e9bc9201668fd851c7112c90ae53b032"
server_key_version: "encryptionkey@0"
I20260809 02:26:04.771637 32659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:04.785181 32659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:04.788699 32659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:04.788919 32659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:04.797140 32659 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.188:38955
I20260809 02:26:04.797469 415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.188:38955 every 8 connection(s)
I20260809 02:26:04.798337 32659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/data/info.pb
I20260809 02:26:04.801312 416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:04.805160 416 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:26:04.807163 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 32659
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242364, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.188@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.214.188@KRBTEST.COM
I20260809 02:26:04.819253 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.807226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39512 (local address 127.21.214.190:44511)
0809 02:26:04.807374 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.807379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.808326 (+ 947us) server_negotiation.cc:407] Connection header received
0809 02:26:04.809375 (+ 1049us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.809378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.809445 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.809539 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.810405 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.810973 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.812009 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.812241 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.812356 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.815336 (+ 2980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.815340 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.815343 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.815378 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.816989 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.817501 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.817505 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.817507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.817594 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.817990 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.817994 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.817996 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.818195 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.818312 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.818941 (+ 629us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.819071 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 02:26:04.820199 418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.807545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:39512)
0809 02:26:04.808080 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.808134 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.809151 (+ 1017us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.809595 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.809600 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.809971 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.810236 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.810250 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.811114 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.811125 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.811871 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.811880 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.812411 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.812416 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.812574 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.813261 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.813285 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.815069 (+ 1784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.817115 (+ 2046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.817125 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.817134 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.817386 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.817751 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.817756 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.817758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.817887 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.818313 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.818320 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.818696 (+ 376us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.818897 (+ 201us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.819221 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":22,"thread_start_us":153,"threads_started":1}
I20260809 02:26:04.820200 419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.808001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54434 (local address 127.21.214.188:38955)
0809 02:26:04.808500 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.808515 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.808555 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:26:04.809169 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.809202 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.809397 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.809593 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.810453 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.811321 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.812142 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.812522 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.812686 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.815623 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.815628 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.815638 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.815659 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.817250 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.817694 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.817704 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.817707 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.817823 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.818113 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.818116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.818118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.818742 (+ 624us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.818973 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.819268 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.819554 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":395,"thread_start_us":128,"threads_started":1}
I20260809 02:26:04.821604 416 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242364, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.188@KRBTEST.COM for oryx/127.21.214.189@KRBTEST.COM
I20260809 02:26:04.830093 418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.822150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40483 (local address 127.0.0.1:38168)
0809 02:26:04.822309 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.822327 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.822411 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.822876 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.822878 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.823008 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.823100 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.823105 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.824022 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.824025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.824573 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.824582 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.825048 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.825051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.825126 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.825658 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.825669 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.827090 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.828754 (+ 1664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.828756 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.828758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.828956 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.829233 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.829235 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.829236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.829319 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.829692 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.829694 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.829788 (+ 94us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.829874 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.829976 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260809 02:26:04.830253 423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.822284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38168 (local address 127.21.214.189:40483)
0809 02:26:04.822661 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.822674 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.822685 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:26:04.822721 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.822723 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.822762 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.822833 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.823212 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.823918 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.824690 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.824933 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.825060 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.827240 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.827243 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.827245 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.827267 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.828630 (+ 1363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.829052 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.829055 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.829057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.829138 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.829411 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.829414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.829415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.829594 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.829690 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.829956 (+ 266us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.830070 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":133,"threads_started":1}
I20260809 02:26:04.831076 416 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242364, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.188@KRBTEST.COM for oryx/127.21.214.188@KRBTEST.COM
I20260809 02:26:04.838959 419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.831630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54442 (local address 127.21.214.188:38955)
0809 02:26:04.831751 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.831755 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.831768 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:26:04.831863 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.831865 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.831923 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.832006 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.832362 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.832859 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.833599 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.833848 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.833958 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.835907 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.835911 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.835913 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.835941 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.837244 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.837697 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.837703 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.837705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.837785 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.838052 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.838058 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.838059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.838227 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.838343 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.838655 (+ 312us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.838799 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":45}
I20260809 02:26:04.838959 418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.831535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:38955 (local address 127.0.0.1:54442)
0809 02:26:04.831683 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.831699 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.831774 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.832015 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.832018 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.832190 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.832253 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.832258 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.832975 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.832980 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.833480 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.833487 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.833959 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.833962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.834036 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.834520 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.834531 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.835774 (+ 1243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.837402 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.837405 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.837407 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.837598 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.837879 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.837883 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.837885 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.837966 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.838332 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.838335 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.838476 (+ 141us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.838598 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.838742 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 02:26:04.843071 416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: Bootstrap starting.
I20260809 02:26:04.845875 416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:04.846771 416 log.cc:824] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:04.848944 416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: No bootstrap required, opened a new log
I20260809 02:26:04.852237 416 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } }
I20260809 02:26:04.852448 416 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:04.852490 416 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe0634cb74da4dd1ae30ed10da3896ae, State: Initialized, Role: FOLLOWER
I20260809 02:26:04.852886 416 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } }
I20260809 02:26:04.853349 426 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } } }
I20260809 02:26:04.853477 426 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:26:04.854082 416 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: configured and running, proceeding with master startup.
W20260809 02:26:04.859488 440 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:26:04.859593 440 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:26:04.863286 32659 master_runner.cc:428] Detected that this master fe0634cb74da4dd1ae30ed10da3896ae is joining an existing cluster
I20260809 02:26:04.863353 32659 master_runner.cc:432] Initiating AddMaster RPC to add 127.21.214.188:38955
I20260809 02:26:04.873842 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 31897
I20260809 02:26:04.885257 451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.865786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40483 (local address 127.0.0.1:38176)
0809 02:26:04.866514 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.866530 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.866689 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.867103 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.867105 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.867505 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.867769 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.867779 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.869147 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.869150 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.870109 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.870120 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.870873 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.870881 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.871021 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.871622 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.871633 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.871997 (+ 364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.882926 (+ 10929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.882929 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.882931 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.883217 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.883718 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.883721 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.883723 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.883847 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.884505 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.884509 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.884671 (+ 162us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.884833 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.885021 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"mutex_wait_us":30,"thread_start_us":142,"threads_started":1}
I20260809 02:26:04.885263 423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.865968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38176 (local address 127.21.214.189:40483)
0809 02:26:04.866234 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.866238 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.866601 (+ 363us) server_negotiation.cc:407] Connection header received
0809 02:26:04.866816 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.866822 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.866882 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.866938 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.867921 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.868750 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.870246 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.870639 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.870718 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.872225 (+ 1507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.872229 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.872232 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.872258 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.874080 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.883369 (+ 9289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.883373 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.883375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.883483 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.883994 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.884000 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.884003 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.884314 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.884408 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.884933 (+ 525us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.885108 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168}
I20260809 02:26:04.892030 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:40687
--local_ip_for_outbound_sockets=127.21.214.129
--tserver_master_addrs=127.21.214.190:44511
--webserver_port=35499
--webserver_interface=127.21.214.129
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab
--principal=oryx/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.21.214.190:44511,127.21.214.189:40483
--tserver_master_addrs=127.21.214.190:44511,127.21.214.189:40483,127.21.214.188:38955 with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:26:04.896504 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.866098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39528 (local address 127.21.214.190:44511)
0809 02:26:04.866231 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.866235 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.866720 (+ 485us) server_negotiation.cc:407] Connection header received
0809 02:26:04.866823 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.866826 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.866877 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.866960 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.867946 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.868775 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.870096 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.870474 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.870562 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.891980 (+ 21418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.891985 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.891988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.892020 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.894226 (+ 2206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.894942 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.894947 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.894948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.895042 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.895418 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.895421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.895423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.895684 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.895778 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.896179 (+ 401us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.896331 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:26:04.896772 419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.866509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54456 (local address 127.21.214.188:38955)
0809 02:26:04.866616 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.866622 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.867063 (+ 441us) server_negotiation.cc:407] Connection header received
0809 02:26:04.867246 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.867250 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.867295 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.867344 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.867963 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.868723 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.870531 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.870846 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.870945 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.891991 (+ 21046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.891994 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.891997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.892016 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.894220 (+ 2204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.895215 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.895220 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.895222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.895314 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.895707 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.895713 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.895715 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.895973 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.896062 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.896472 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.896603 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":36}
I20260809 02:26:04.896999 450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.865786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:39528)
0809 02:26:04.866633 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.866645 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.866738 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.867089 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.867092 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.867494 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.867791 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.867804 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.868928 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.868931 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.869954 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.869965 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.870739 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.870742 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.871151 (+ 409us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.891180 (+ 20029us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.891206 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.891763 (+ 557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.894351 (+ 2588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.894354 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.894357 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.894814 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.895173 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.895175 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.895178 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.895264 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.895873 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.895876 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.895974 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.896674 (+ 700us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.896826 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":786,"mutex_wait_us":180,"thread_start_us":113,"threads_started":1}
I20260809 02:26:04.897323 453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.866295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:38955 (local address 127.0.0.1:54456)
0809 02:26:04.866991 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.867004 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.867110 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.867481 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.867484 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.867686 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.867858 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.867869 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.868858 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.868864 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.870396 (+ 1532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.870404 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.870952 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.870955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.871088 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.891436 (+ 20348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.891455 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.891866 (+ 411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.894649 (+ 2783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.894652 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.894654 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.895095 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.895475 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.895479 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.895483 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.895578 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.896180 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.896183 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.896292 (+ 109us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.896408 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.897147 (+ 739us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"mutex_wait_us":641,"thread_start_us":104,"threads_started":1}
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242363, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.190@KRBTEST.COM for oryx/127.21.214.188@KRBTEST.COM
I20260809 02:26:04.909272 32640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.901291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:38955 (local address 127.0.0.1:54460)
0809 02:26:04.901401 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.901418 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.901500 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.901824 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.901827 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.902012 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.902098 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.902103 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.902915 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.902920 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.903479 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.903487 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.903958 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.903962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.904070 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.904549 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.904561 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.905849 (+ 1288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.907734 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.907739 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.907741 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.907947 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.908237 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.908241 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.908243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.908333 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.908718 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.908721 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.908826 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.908936 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.909093 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 02:26:04.909272 419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.901470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54460 (local address 127.21.214.188:38955)
0809 02:26:04.901586 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.901590 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.901600 (+ 10us) server_negotiation.cc:407] Connection header received
0809 02:26:04.901674 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.901676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.901716 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.901805 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.902219 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.902806 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.903609 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.903837 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.903943 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.905995 (+ 2052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.905999 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.906000 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.906022 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.907618 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.908051 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.908055 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.908057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.908137 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.908428 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.908432 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.908434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.908614 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.908726 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.908992 (+ 266us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.909104 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:26:04.910663 31797 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.21.214.188:38955: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae"
member_type: NON_VOTER
last_known_addr {
host: "127.21.214.188"
port: 38955
}
attrs {
promote: true
}
}
dest_uuid: "3eedaf8b154b4549842034052633030d"
cas_config_opid_index: 5
I20260809 02:26:04.911283 31797 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } }
I20260809 02:26:04.912474 32644 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER fe0634cb74da4dd1ae30ed10da3896ae (127.21.214.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:04.913857 32644 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.21.214.188:38955
I20260809 02:26:04.914038 32644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:04.914170 32644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:04.915140 32659 master.cc:537] Master@127.21.214.188:38955 shutting down...
I20260809 02:26:04.915540 379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:04.917948 379 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 1 FOLLOWER]: Refusing update from remote peer 3eedaf8b154b4549842034052633030d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 02:26:04.918639 32647 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 02:26:04.920531 31775 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d -> Peer fe0634cb74da4dd1ae30ed10da3896ae (127.21.214.188:38955): Couldn't send request to peer fe0634cb74da4dd1ae30ed10da3896ae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 02:26:04.924064 32659 raft_consensus.cc:2229] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:04.924469 32659 raft_consensus.cc:2258] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:04.924659 32659 tablet_replica.cc:330] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: stopping tablet replica
I20260809 02:26:04.928680 32640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.912605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40483 (local address 127.0.0.1:38184)
0809 02:26:04.922999 (+ 10394us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.923018 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.923171 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.923692 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.923695 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.923717 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:04.923862 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.923871 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.924954 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.924957 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.926177 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.926189 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.928249 (+ 2060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.928253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.928331 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.928371 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.928454 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.928540 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10305}
I20260809 02:26:04.928681 423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.914382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38184 (local address 127.21.214.189:40483)
0809 02:26:04.914580 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.914587 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.923087 (+ 8500us) server_negotiation.cc:407] Connection header received
0809 02:26:04.923314 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.923317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.923398 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.923484 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:04.924038 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.924806 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.926324 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.927026 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.927135 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.927242 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.928485 (+ 1243us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.928560 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260809 02:26:04.929380 32720 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 LEARNER]: Refusing update from remote peer 3eedaf8b154b4549842034052633030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 02:26:04.929908 32647 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 02:26:04.931823 32659 master.cc:552] Master@127.21.214.188:38955 shutdown complete.
I20260809 02:26:04.931922 32659 master_runner.cc:305] Clearing existing system tablet
I20260809 02:26:04.932363 32659 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:04.932467 32659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:04.932197 32720 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER fe0634cb74da4dd1ae30ed10da3896ae (127.21.214.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:04.933931 32659 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:26:04.934964 32765 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eedaf8b154b4549842034052633030d. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:04.935057 32765 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: This master's current role is: LEARNER
I20260809 02:26:04.935127 32765 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:04.935204 32765 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: This master's current role is: LEARNER
I20260809 02:26:04.935722 459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:04.935923 32659 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:04.936081 32659 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:26:04.936120 32659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/wal
uuid: "fe0634cb74da4dd1ae30ed10da3896ae"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "cc057b82ec57be2441da35280177866c"
server_key_iv: "e9bc9201668fd851c7112c90ae53b032"
server_key_version: "encryptionkey@0"
I20260809 02:26:04.937774 32659 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:04.939790 32659 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 02:26:04.939908 32659 log.cc:1196] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 02:26:04.940160 32659 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: Deleting consensus metadata
I20260809 02:26:04.940351 32659 master_runner.cc:315] Copying system tablet from 127.21.214.190:44511
I20260809 02:26:04.941586 32659 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: tablet copy: Beginning tablet copy session from remote peer at address 127.21.214.190:44511
I20260809 02:26:04.948374 32647 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d: attempting to promote NON_VOTER e20873ff3d1e4564ad945b14e17c51f3 to VOTER
I20260809 02:26:04.948999 32647 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } }
I20260809 02:26:04.951016 32640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.950661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:38955 (local address 127.0.0.1:54474)
0809 02:26:04.950832 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.950916 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:38955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260809 02:26:04.951692 32720 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 LEARNER]: Refusing update from remote peer 3eedaf8b154b4549842034052633030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 02:26:04.951916 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.942299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39532 (local address 127.21.214.190:44511)
0809 02:26:04.942464 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:04.942468 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:04.942767 (+ 299us) server_negotiation.cc:407] Connection header received
0809 02:26:04.942956 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:04.942959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:04.943010 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:04.943106 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:04.943602 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.944237 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.945094 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.945474 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.945596 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.947038 (+ 1442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:04.947042 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:04.947045 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:04.947073 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:04.949464 (+ 2391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.950037 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.950040 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.950042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.950137 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:04.950599 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:04.950603 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:04.950604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:04.950852 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:04.950926 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:04.951524 (+ 598us) server_negotiation.cc:299] Negotiation successful
0809 02:26:04.951646 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:26:04.952541 32644 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 02:26:04.952766 468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.942227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:39532)
0809 02:26:04.942667 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.942679 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:04.942816 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:04.943133 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:04.943136 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:04.943353 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:04.943461 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.943467 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.944354 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.944358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.944947 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:04.944955 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:04.945603 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:04.945607 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:04.945713 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:04.946321 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:04.946333 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:04.946865 (+ 532us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:04.949609 (+ 2744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.949615 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.949617 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.949913 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.950267 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:04.950270 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:04.950271 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:04.950374 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:04.951004 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:04.951006 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:04.951329 (+ 323us) client_negotiation.cc:769] Sending connection context
0809 02:26:04.952280 (+ 951us) client_negotiation.cc:240] Negotiation successful
0809 02:26:04.952460 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":129,"threads_started":1}
I20260809 02:26:04.953311 32640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:04.952979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:38955 (local address 127.0.0.1:54488)
0809 02:26:04.953132 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:04.953200 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:38955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260809 02:26:04.953373 31832 tablet_copy_service.cc:140] P 3eedaf8b154b4549842034052633030d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer fe0634cb74da4dd1ae30ed10da3896ae ({username='oryx', principal='oryx/127.21.214.188@KRBTEST.COM'} at 127.0.0.1:39532)
I20260809 02:26:04.953447 31832 tablet_copy_service.cc:161] P 3eedaf8b154b4549842034052633030d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer fe0634cb74da4dd1ae30ed10da3896ae at {username='oryx', principal='oryx/127.21.214.188@KRBTEST.COM'} at 127.0.0.1:39532: session id = fe0634cb74da4dd1ae30ed10da3896ae-00000000000000000000000000000000
W20260809 02:26:04.954288 31775 consensus_peers.cc:487] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d -> Peer fe0634cb74da4dd1ae30ed10da3896ae (127.21.214.188:38955): Couldn't send request to peer fe0634cb74da4dd1ae30ed10da3896ae. Status: Network error: Client connection negotiation failed: client connection to 127.21.214.188:38955: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 02:26:04.954864 31832 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 02:26:04.955350 32644 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, e20873ff3d1e4564ad945b14e17c51f3 (127.21.214.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:04.956314 32659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 02:26:04.956880 32644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:04.956976 32644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:04.957140 32644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:04.957218 32644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:04.958050 32720 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, e20873ff3d1e4564ad945b14e17c51f3 (127.21.214.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:04.959007 32659 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: tablet copy: Starting download of 0 data blocks...
I20260809 02:26:04.959203 32659 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: tablet copy: Starting download of 1 WAL segments...
I20260809 02:26:04.959813 457 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:04.959939 457 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:26:04.960952 32659 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 02:26:04.962646 31832 tablet_copy_service.cc:342] P 3eedaf8b154b4549842034052633030d: Request end of tablet copy session fe0634cb74da4dd1ae30ed10da3896ae-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.21.214.188@KRBTEST.COM'} at 127.0.0.1:39532
I20260809 02:26:04.962750 31832 tablet_copy_service.cc:433] P 3eedaf8b154b4549842034052633030d: ending tablet copy session fe0634cb74da4dd1ae30ed10da3896ae-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer fe0634cb74da4dd1ae30ed10da3896ae
I20260809 02:26:04.970204 32659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:04.972025 478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:04.972091 474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:04.972427 475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:04.972527 32659 server_base.cc:1034] running on GCE node
I20260809 02:26:04.972795 32659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:04.973134 32659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:04.974328 32659 hybrid_clock.cc:648] HybridClock initialized: now 1786242364974331 us; error 48 us; skew 500 ppm
Aug 09 02:26:04 dist-test-slave-68xk krb5kdc[31731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242364, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:04.976060 32659 init.cc:377] Logged in from keytab as oryx/127.21.214.188@KRBTEST.COM (short username oryx)
I20260809 02:26:04.976529 32659 webserver.cc:460] Webserver started at http://127.21.214.188:33935/ using document root <none> and password file <none>
I20260809 02:26:04.976715 32659 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:04.976753 32659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:04.982808 32659 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.001s sys 0.000s
I20260809 02:26:04.983893 488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:04.984140 32659 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 02:26:04.984242 32659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/wal
uuid: "fe0634cb74da4dd1ae30ed10da3896ae"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "cc057b82ec57be2441da35280177866c"
server_key_iv: "e9bc9201668fd851c7112c90ae53b032"
server_key_version: "encryptionkey@0"
I20260809 02:26:04.984350 32659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:04.997874 32287 heartbeater.cc:503] Master 127.21.214.190:44511 was elected leader, sending a full tablet report...
I20260809 02:26:04.998983 32659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:05.001073 32659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:05.009765 32659 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.188:38955
I20260809 02:26:05.010557 32659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/master-2/data/info.pb
I20260809 02:26:05.018868 575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.188:38955 every 8 connection(s)
I20260809 02:26:05.020524 576 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:26:05.021561 576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: Bootstrap starting.
I20260809 02:26:05.030977 576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=6 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260809 02:26:05.031373 576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: Bootstrap complete.
I20260809 02:26:05.031893 576 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 1 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } }
I20260809 02:26:05.032297 576 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fe0634cb74da4dd1ae30ed10da3896ae, State: Initialized, Role: LEARNER
I20260809 02:26:05.032452 576 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } }
I20260809 02:26:05.032923 579 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: NON_VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: true } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:05.033119 576 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:26:05.033125 579 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: This master's current role is: LEARNER
I20260809 02:26:05.036325 594 catalog_manager.cc:1259] Loaded cluster ID: eb48c3c31dc54750820198d28737ad6b
I20260809 02:26:05.036443 594 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: loading cluster ID for follower catalog manager: success
I20260809 02:26:05.038224 594 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: acquiring CA information for follower catalog manager: success
I20260809 02:26:05.039408 594 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 02:26:05.060774 454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:05.061115 454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:05.061192 454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:05.067350 454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:05.067442 454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:05.067530 454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:26:05.076104 454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab
--principal=oryx/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:40687
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=35499
--tserver_master_addrs=127.21.214.190:44511,127.21.214.189:40483,127.21.214.188:38955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:05.077461 454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:05.078766 454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:05.091372 603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:05.091320 606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:05.091903 612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:05.092026 454 server_base.cc:1034] running on GCE node
I20260809 02:26:05.092464 454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:05.093134 454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:05.094298 454 hybrid_clock.cc:648] HybridClock initialized: now 1786242365094286 us; error 34 us; skew 500 ppm
Aug 09 02:26:05 dist-test-slave-68xk krb5kdc[31731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242365, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:05.097540 454 init.cc:377] Logged in from keytab as oryx/127.21.214.129@KRBTEST.COM (short username oryx)
I20260809 02:26:05.098541 454 webserver.cc:460] Webserver started at http://127.21.214.129:35499/ using document root <none> and password file <none>
I20260809 02:26:05.099083 454 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:05.099157 454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:05.103008 454 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:26:05.105197 623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:05.106554 454 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:26:05.106688 454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "663a460229954475b4b523e589106efc"
format_stamp: "Formatted at 2026-08-09 02:26:03 on dist-test-slave-68xk"
server_key: "563aef5cbe81defca0d0914aefa6f6ab"
server_key_iv: "c42cc820019c38debce5aa1700f91d86"
server_key_version: "encryptionkey@0"
I20260809 02:26:05.107259 454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:05.127527 454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:05.131106 454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:05.131330 454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:05.132092 454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:05.133128 454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:05.133195 454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:05.133272 454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:05.133320 454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:05.144169 454 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:40687
I20260809 02:26:05.144256 790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:40687 every 8 connection(s)
I20260809 02:26:05.145311 454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:26:05.154855 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 454
I20260809 02:26:05.155073 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 32103
Aug 09 02:26:05 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242365, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
Aug 09 02:26:05 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242365, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.188@KRBTEST.COM
I20260809 02:26:05.161972 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.147392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:48007 (local address 127.21.214.190:44511)
0809 02:26:05.147553 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.147560 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.148791 (+ 1231us) server_negotiation.cc:407] Connection header received
0809 02:26:05.150141 (+ 1350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.150145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.150196 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.150250 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.152628 (+ 2378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.153225 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.154151 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.154505 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.154604 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.157879 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.157885 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.157890 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.157922 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.159582 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.160175 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.160181 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.160185 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.160264 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.160657 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.160663 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.160667 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.160897 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.160963 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.161611 (+ 648us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.161746 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 02:26:05.163517 795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.147937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.129:48007)
0809 02:26:05.148702 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.148716 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.149873 (+ 1157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.150463 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.150473 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.150983 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:05.151542 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.151551 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.153340 (+ 1789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.153347 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.154013 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.154022 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.154792 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.154797 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.154999 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.155864 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:05.155888 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:05.157694 (+ 1806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:05.159723 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.159731 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.159759 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.160072 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.160382 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.160387 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.160391 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.160561 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.161037 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:05.161045 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:05.161337 (+ 292us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.162132 (+ 795us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.162492 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"mutex_wait_us":161,"spinlock_wait_cycles":43776,"thread_start_us":166,"threads_started":1}
I20260809 02:26:05.164949 797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.149049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:38955 (local address 127.21.214.129:55089)
0809 02:26:05.149336 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.149357 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.149890 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.150464 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.150473 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.150975 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:05.151500 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.151513 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.152839 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.152844 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.154154 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.154165 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.155050 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.155054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.155194 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.157439 (+ 2245us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:05.157460 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:05.159485 (+ 2025us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:05.162571 (+ 3086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.162577 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.162582 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.162919 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.163374 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.163380 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.163385 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.163507 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.164349 (+ 842us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:05.164355 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:05.164453 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.164560 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.164700 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"mutex_wait_us":145,"thread_start_us":107,"threads_started":1}
I20260809 02:26:05.165164 798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.149512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:55089 (local address 127.21.214.188:38955)
0809 02:26:05.149802 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.149808 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.149835 (+ 27us) server_negotiation.cc:407] Connection header received
0809 02:26:05.150090 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.150094 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.150155 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.150249 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.151645 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.152714 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.154327 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.154766 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.154882 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.159691 (+ 4809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.159698 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.159704 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.159744 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.162360 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.163084 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.163091 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.163095 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.163231 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.163646 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.163652 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.163657 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.163979 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.164114 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.164675 (+ 561us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.164864 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":111,"threads_started":1}
I20260809 02:26:05.167683 792 heartbeater.cc:347] Connected to a master server at 127.21.214.190:44511
I20260809 02:26:05.168020 792 heartbeater.cc:464] Registering TS with master...
Aug 09 02:26:05 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242365, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.189@KRBTEST.COM
I20260809 02:26:05.168836 792 heartbeater.cc:511] Master 127.21.214.190:44511 requested a full tablet report, sending...
I20260809 02:26:05.170774 31797 ts_manager.cc:194] Re-registered known tserver with Master: 663a460229954475b4b523e589106efc (127.21.214.129:40687)
I20260809 02:26:05.171573 31797 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:48007
I20260809 02:26:05.172360 423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.147510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:38317 (local address 127.21.214.189:40483)
0809 02:26:05.147920 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.147924 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.148796 (+ 872us) server_negotiation.cc:407] Connection header received
0809 02:26:05.150127 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.150130 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.150194 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.150250 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.151709 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.152489 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.154287 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.154659 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.154761 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.168736 (+ 13975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.168740 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.168743 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.168771 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.170533 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.171028 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.171031 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.171033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.171118 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.171429 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.171432 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.171434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.171639 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.171712 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.172089 (+ 377us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.172218 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300}
I20260809 02:26:05.172845 796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.147937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40483 (local address 127.21.214.129:38317)
0809 02:26:05.148611 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.148675 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.149873 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.150463 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.150473 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.150983 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:05.151542 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.151551 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.152656 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.152658 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.154154 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.154165 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.154875 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.154878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.155048 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.167261 (+ 12213us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:05.167274 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:05.168571 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:05.170665 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.170668 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.170670 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.170908 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.171231 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.171234 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.171236 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.171329 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.171790 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:05.171796 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:05.171898 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.172572 (+ 674us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.172715 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":293,"spinlock_wait_cycles":49152,"thread_start_us":141,"threads_started":1}
I20260809 02:26:05.173538 793 heartbeater.cc:347] Connected to a master server at 127.21.214.189:40483
I20260809 02:26:05.173650 793 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:05.173828 793 heartbeater.cc:511] Master 127.21.214.189:40483 requested a full tablet report, sending...
I20260809 02:26:05.174966 32708 ts_manager.cc:194] Registered new tserver with Master: 663a460229954475b4b523e589106efc (127.21.214.129:40687)
I20260809 02:26:05.180043 791 heartbeater.cc:347] Connected to a master server at 127.21.214.188:38955
I20260809 02:26:05.180145 791 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:05.180335 791 heartbeater.cc:511] Master 127.21.214.188:38955 requested a full tablet report, sending...
I20260809 02:26:05.183022 512 ts_manager.cc:194] Registered new tserver with Master: 663a460229954475b4b523e589106efc (127.21.214.129:40687)
I20260809 02:26:05.188251 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:45379
--local_ip_for_outbound_sockets=127.21.214.130
--tserver_master_addrs=127.21.214.190:44511
--webserver_port=37791
--webserver_interface=127.21.214.130
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab
--principal=oryx/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.21.214.190:44511,127.21.214.189:40483
--tserver_master_addrs=127.21.214.190:44511,127.21.214.189:40483,127.21.214.188:38955 with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:26:05.241518 32495 heartbeater.cc:503] Master 127.21.214.190:44511 was elected leader, sending a full tablet report...
W20260809 02:26:05.308009 799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:05.308269 799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:05.308349 799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:05.312443 799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:05.312501 799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:05.312559 799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:26:05.317731 799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab
--principal=oryx/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:45379
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=37791
--tserver_master_addrs=127.21.214.190:44511,127.21.214.189:40483,127.21.214.188:38955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:05.318898 799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:05.319994 799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:05.330237 805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:05.330322 807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:05.330250 804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:05.330660 799 server_base.cc:1034] running on GCE node
I20260809 02:26:05.331152 799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:05.331840 799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:05.333055 799 hybrid_clock.cc:648] HybridClock initialized: now 1786242365333042 us; error 32 us; skew 500 ppm
Aug 09 02:26:05 dist-test-slave-68xk krb5kdc[31731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242365, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:05.336364 799 init.cc:377] Logged in from keytab as oryx/127.21.214.130@KRBTEST.COM (short username oryx)
I20260809 02:26:05.337329 799 webserver.cc:460] Webserver started at http://127.21.214.130:37791/ using document root <none> and password file <none>
I20260809 02:26:05.337941 799 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:05.338064 799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:05.342198 799 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:26:05.344594 817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:05.346035 799 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:26:05.346181 799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "f20e3d7982964ac9be3d5e3c1866bfe1"
format_stamp: "Formatted at 2026-08-09 02:26:03 on dist-test-slave-68xk"
server_key: "8360411adb939c8442335ac02d2a5087"
server_key_iv: "366bac2bd66633e6588955fcebb8646e"
server_key_version: "encryptionkey@0"
I20260809 02:26:05.346854 799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:05.359122 799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:05.361922 799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:05.362128 799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:05.362787 799 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:05.363658 799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:05.363741 799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:05.363832 799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:05.363883 799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:05.373502 799 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:45379
I20260809 02:26:05.373538 984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:45379 every 8 connection(s)
I20260809 02:26:05.374564 799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:26:05.375684 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 799
I20260809 02:26:05.375885 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 32293
I20260809 02:26:05.387650 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:41855
--local_ip_for_outbound_sockets=127.21.214.131
--tserver_master_addrs=127.21.214.190:44511
--webserver_port=38735
--webserver_interface=127.21.214.131
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab
--principal=oryx/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.21.214.190:44511,127.21.214.189:40483
--tserver_master_addrs=127.21.214.190:44511,127.21.214.189:40483,127.21.214.188:38955 with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:26:05 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242365, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.189@KRBTEST.COM
Aug 09 02:26:05 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242365, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.188@KRBTEST.COM
Aug 09 02:26:05 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242365, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
I20260809 02:26:05.395664 798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.378350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:60905 (local address 127.21.214.188:38955)
0809 02:26:05.379420 (+ 1070us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.379426 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.382024 (+ 2598us) server_negotiation.cc:407] Connection header received
0809 02:26:05.382484 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.382491 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.382582 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.382677 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.383213 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.384101 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.385687 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.386113 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.386219 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.389243 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.389247 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.389250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.389279 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.391734 (+ 2455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.393535 (+ 1801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.393540 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.393542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.393647 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.394101 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.394105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.394107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.394388 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.394500 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.395319 (+ 819us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.395468 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":961}
I20260809 02:26:05.395668 423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.379071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:45625 (local address 127.21.214.189:40483)
0809 02:26:05.379261 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.379268 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.379292 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:26:05.380619 (+ 1327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.380626 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.380695 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.380793 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.382493 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.383283 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.385008 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.385358 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.385449 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.389250 (+ 3801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.389254 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.389256 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.389285 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.392693 (+ 3408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.393850 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.393854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.393856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.393947 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.394309 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.394312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.394314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.394604 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.394694 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.395319 (+ 625us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.395462 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 02:26:05.395741 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.380604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:37545 (local address 127.21.214.190:44511)
0809 02:26:05.380734 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.380738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.383726 (+ 2988us) server_negotiation.cc:407] Connection header received
0809 02:26:05.383914 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.383917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.383970 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.384023 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.384622 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.385393 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.387144 (+ 1751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.387527 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.387612 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.390717 (+ 3105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.390726 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.390736 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.390774 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.392693 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.393608 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.393615 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.393619 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.393725 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.394122 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.394128 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.394131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.394406 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.394569 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.395331 (+ 762us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.395484 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:26:05.397624 993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.376863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40483 (local address 127.21.214.130:45625)
0809 02:26:05.379096 (+ 2233us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.379156 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.380334 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.380992 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.381004 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.381557 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:05.382288 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.382310 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.383434 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.383441 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.384869 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.384879 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.385670 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.385674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.385876 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.386568 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:05.386589 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:05.389034 (+ 2445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:05.392847 (+ 3813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.392851 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.392862 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.393722 (+ 860us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.394085 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.394088 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.394090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.394187 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.394779 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:05.394782 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:05.394977 (+ 195us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.395928 (+ 951us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.396394 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1978,"mutex_wait_us":4,"spinlock_wait_cycles":12544,"thread_start_us":1262,"threads_started":1}
I20260809 02:26:05.397903 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.380336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.130:37545)
0809 02:26:05.383620 (+ 3284us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.383637 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.383799 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.384181 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.384184 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.384373 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:05.384478 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.384485 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.385537 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.385541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.386710 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.386724 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.387808 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.387812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.387913 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.388425 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:05.388445 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:05.390564 (+ 2119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:05.392828 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.392838 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.392861 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.393453 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.393855 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.393860 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.393865 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.393996 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.394642 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:05.394649 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:05.394990 (+ 341us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.395996 (+ 1006us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.396501 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3216,"mutex_wait_us":198,"spinlock_wait_cycles":11904,"thread_start_us":86,"threads_started":1}
I20260809 02:26:05.397672 994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.379195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:38955 (local address 127.21.214.130:60905)
0809 02:26:05.381897 (+ 2702us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.381912 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.382021 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.382722 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.382725 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.382954 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:05.383074 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.383080 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.384301 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.384307 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.385492 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.385507 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.386441 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.386448 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.386606 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.387129 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:05.387150 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:05.389033 (+ 1883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:05.393090 (+ 4057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.393093 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.393094 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.393414 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.393770 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.393776 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.393778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.393973 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.394594 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:05.394601 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:05.394977 (+ 376us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.396568 (+ 1591us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.396712 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2634,"mutex_wait_us":3,"spinlock_wait_cycles":80896,"thread_start_us":115,"threads_started":1}
I20260809 02:26:05.399114 988 heartbeater.cc:347] Connected to a master server at 127.21.214.189:40483
I20260809 02:26:05.399387 988 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:05.399960 988 heartbeater.cc:511] Master 127.21.214.189:40483 requested a full tablet report, sending...
I20260809 02:26:05.400513 987 heartbeater.cc:347] Connected to a master server at 127.21.214.190:44511
I20260809 02:26:05.400609 987 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:05.400811 987 heartbeater.cc:511] Master 127.21.214.190:44511 requested a full tablet report, sending...
I20260809 02:26:05.401006 985 heartbeater.cc:347] Connected to a master server at 127.21.214.188:38955
I20260809 02:26:05.401085 985 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:05.401235 985 heartbeater.cc:511] Master 127.21.214.188:38955 requested a full tablet report, sending...
I20260809 02:26:05.401335 32708 ts_manager.cc:194] Registered new tserver with Master: f20e3d7982964ac9be3d5e3c1866bfe1 (127.21.214.130:45379)
I20260809 02:26:05.401841 31797 ts_manager.cc:194] Re-registered known tserver with Master: f20e3d7982964ac9be3d5e3c1866bfe1 (127.21.214.130:45379)
I20260809 02:26:05.402102 512 ts_manager.cc:194] Registered new tserver with Master: f20e3d7982964ac9be3d5e3c1866bfe1 (127.21.214.130:45379)
I20260809 02:26:05.402668 31797 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:37545
W20260809 02:26:05.509752 997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:05.510004 997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:05.510052 997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:05.514356 997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:05.514433 997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:05.514492 997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:26:05.519685 997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab
--principal=oryx/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:41855
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=38735
--tserver_master_addrs=127.21.214.190:44511,127.21.214.189:40483,127.21.214.188:38955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:05.520779 997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:05.521842 997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:05.531875 1008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:05.531868 1006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:05.532073 997 server_base.cc:1034] running on GCE node
W20260809 02:26:05.531868 1004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:05.532653 997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:05.533309 997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:05.534495 997 hybrid_clock.cc:648] HybridClock initialized: now 1786242365534450 us; error 48 us; skew 500 ppm
Aug 09 02:26:05 dist-test-slave-68xk krb5kdc[31731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242365, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:05.537480 997 init.cc:377] Logged in from keytab as oryx/127.21.214.131@KRBTEST.COM (short username oryx)
I20260809 02:26:05.538378 997 webserver.cc:460] Webserver started at http://127.21.214.131:38735/ using document root <none> and password file <none>
I20260809 02:26:05.539001 997 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:05.539078 997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:05.543164 997 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 02:26:05.545329 1017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:05.546679 997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:26:05.546810 997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "b8988bbb9ebf40029d49a50e95639df6"
format_stamp: "Formatted at 2026-08-09 02:26:04 on dist-test-slave-68xk"
server_key: "04f5f47a9c69910191df96b93b93ee94"
server_key_iv: "91399f806e9b482bc5d1342c48328dba"
server_key_version: "encryptionkey@0"
I20260809 02:26:05.547394 997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:05.559906 798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.556131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54494 (local address 127.21.214.188:38955)
0809 02:26:05.556306 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.556310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.556376 (+ 66us) server_negotiation.cc:407] Connection header received
0809 02:26:05.556517 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.556519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.556575 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.556674 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:05.556946 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.557477 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.558956 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.559406 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.559508 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.559620 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.559740 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.559802 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260809 02:26:05.559939 1024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.555994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:38955 (local address 127.0.0.1:54494)
0809 02:26:05.556277 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.556293 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.556415 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.556703 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.556707 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.556723 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:05.556835 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.556840 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.557576 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.557579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.558812 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.558825 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.559521 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.559524 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.559612 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.559639 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.559709 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.559792 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":76,"threads_started":1}
I20260809 02:26:05.560753 532 raft_consensus.cc:1203] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 02:26:05.561302 532 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 1 LEARNER]: Committing config change with OpId 1.7: config changed from index 6 to 7, e20873ff3d1e4564ad945b14e17c51f3 (127.21.214.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:05.563315 1030 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:05.563508 1030 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: This master's current role is: LEARNER
I20260809 02:26:05.563783 1026 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eedaf8b154b4549842034052633030d. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:05.563925 1026 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: This master's current role is: LEARNER
I20260809 02:26:05.566041 997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:05.569641 997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:05.569861 997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:05.570564 997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:05.571439 997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:05.571487 997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:05.571554 997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:05.571585 997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:05.581079 997 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:41855
I20260809 02:26:05.581102 1195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:41855 every 8 connection(s)
I20260809 02:26:05.582073 997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:26:05.586155 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 997
Aug 09 02:26:05 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242365, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.189@KRBTEST.COM
Aug 09 02:26:05 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242365, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
Aug 09 02:26:05 dist-test-slave-68xk krb5kdc[31731](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242365, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.188@KRBTEST.COM
I20260809 02:26:05.601279 31866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.584011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:40087 (local address 127.21.214.190:44511)
0809 02:26:05.584175 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.584180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.585291 (+ 1111us) server_negotiation.cc:407] Connection header received
0809 02:26:05.586566 (+ 1275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.586569 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.586628 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.586690 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.590056 (+ 3366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.590862 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.591966 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.592304 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.592397 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.595494 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.595501 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.595506 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.595543 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.598750 (+ 3207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.599579 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.599583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.599584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.599682 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.599997 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.600000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.600002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.600238 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.600313 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.600950 (+ 637us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.601085 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":79}
I20260809 02:26:05.601408 798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.585874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:33897 (local address 127.21.214.188:38955)
0809 02:26:05.586039 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.586044 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.586063 (+ 19us) server_negotiation.cc:407] Connection header received
0809 02:26:05.586566 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.586569 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.586628 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.586687 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.588800 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.589569 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.592098 (+ 2529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.592440 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.593155 (+ 715us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.596691 (+ 3536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.596695 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.596697 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.596722 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.598850 (+ 2128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.599456 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.599460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.599462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.599542 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.599960 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.599963 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.599965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.600175 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.600276 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.601085 (+ 809us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.601227 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 02:26:05.602106 423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.584078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:36359 (local address 127.21.214.189:40483)
0809 02:26:05.584207 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.584212 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.585273 (+ 1061us) server_negotiation.cc:407] Connection header received
0809 02:26:05.586598 (+ 1325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.586605 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.586675 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.586733 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.588772 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.589573 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.591297 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.591680 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.591803 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.595270 (+ 3467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.595274 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.595278 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.595312 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.597864 (+ 2552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.599722 (+ 1858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.599729 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.599732 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.599818 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.600119 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.600122 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.600123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.600334 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.600423 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.601848 (+ 1425us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.601967 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:26:05.602747 1203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.584460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.131:40087)
0809 02:26:05.585186 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.585201 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.586304 (+ 1103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.587110 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.587119 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.587816 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:05.589913 (+ 2097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.589923 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.590981 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.590985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.591834 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.591843 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.592529 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.592533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.592634 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.593104 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:05.593121 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:05.595323 (+ 2202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:05.598892 (+ 3569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.598898 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.598916 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.599479 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.599793 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.599796 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.599798 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.599889 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.600395 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:05.600399 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:05.600649 (+ 250us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.601500 (+ 851us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.601653 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":138,"spinlock_wait_cycles":92928,"thread_start_us":166,"threads_started":1}
I20260809 02:26:05.602748 1207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.585506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:38955 (local address 127.21.214.131:33897)
0809 02:26:05.585753 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.585950 (+ 197us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.586363 (+ 413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.587110 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.587119 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.587835 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:05.588567 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.588588 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.589773 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.589779 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.591982 (+ 2203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.591990 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.593319 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.593323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.593421 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.594974 (+ 1553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:05.594992 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:05.596530 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:05.598993 (+ 2463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.598997 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.598999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.599343 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.599640 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.599646 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.599651 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.599845 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.600333 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:05.600340 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:05.600678 (+ 338us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.600854 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.601993 (+ 1139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":2078,"spinlock_wait_cycles":19456,"thread_start_us":94,"threads_started":1}
I20260809 02:26:05.603449 1206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.584431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40483 (local address 127.21.214.131:36359)
0809 02:26:05.585054 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.585108 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.586311 (+ 1203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.587111 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.587121 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.587827 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:05.588566 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.588588 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.589776 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.589780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.591156 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.591166 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.591985 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.591989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.592205 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.592898 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:05.592922 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:05.595052 (+ 2130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:05.598892 (+ 3840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.598899 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.598916 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.599603 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.599924 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:05.599929 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:05.599934 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:05.600014 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:05.600464 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:05.600466 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:05.600661 (+ 195us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.600857 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.601213 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":204,"spinlock_wait_cycles":21248,"thread_start_us":152,"threads_started":1}
I20260809 02:26:05.604050 1197 heartbeater.cc:347] Connected to a master server at 127.21.214.190:44511
I20260809 02:26:05.604171 1196 heartbeater.cc:347] Connected to a master server at 127.21.214.188:38955
I20260809 02:26:05.604292 1196 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:05.604290 1197 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:05.604493 1200 heartbeater.cc:347] Connected to a master server at 127.21.214.189:40483
I20260809 02:26:05.604561 1200 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:05.604939 1196 heartbeater.cc:511] Master 127.21.214.188:38955 requested a full tablet report, sending...
I20260809 02:26:05.604940 1197 heartbeater.cc:511] Master 127.21.214.190:44511 requested a full tablet report, sending...
I20260809 02:26:05.605630 1200 heartbeater.cc:511] Master 127.21.214.189:40483 requested a full tablet report, sending...
I20260809 02:26:05.606468 32708 ts_manager.cc:194] Registered new tserver with Master: b8988bbb9ebf40029d49a50e95639df6 (127.21.214.131:41855)
I20260809 02:26:05.606484 31797 ts_manager.cc:194] Re-registered known tserver with Master: b8988bbb9ebf40029d49a50e95639df6 (127.21.214.131:41855)
I20260809 02:26:05.606705 512 ts_manager.cc:194] Registered new tserver with Master: b8988bbb9ebf40029d49a50e95639df6 (127.21.214.131:41855)
I20260809 02:26:05.607206 31797 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:40087
I20260809 02:26:05.607478 1214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.588684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39548 (local address 127.21.214.190:44511)
0809 02:26:05.596417 (+ 7733us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.596422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.596437 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:26:05.596477 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.596482 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.596530 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.598674 (+ 2144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.598808 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.599598 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.600724 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.601074 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.601574 (+ 500us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.602796 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.602802 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.602806 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.602833 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.605200 (+ 2367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.605731 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.605737 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.605756 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.605852 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.606181 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.606184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.606185 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.606384 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.607138 (+ 754us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.607212 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.607331 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":7647,"thread_start_us":88,"threads_started":1}
I20260809 02:26:05.607599 1222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.589514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38192 (local address 127.21.214.189:40483)
0809 02:26:05.589777 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.589781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.590576 (+ 795us) server_negotiation.cc:407] Connection header received
0809 02:26:05.590748 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.590751 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.590798 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.590857 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.591882 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.592588 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.594067 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.594305 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.594419 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.596254 (+ 1835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.596259 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.596262 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.596291 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.598763 (+ 2472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.605480 (+ 6717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.605484 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.605485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.605583 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.605987 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.605991 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.605992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.606241 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.606367 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.607288 (+ 921us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.607418 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":85,"threads_started":1}
I20260809 02:26:05.610390 31797 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39548:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:26:05.614625 31797 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:26:05.615391 1221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.589115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54496 (local address 127.21.214.188:38955)
0809 02:26:05.596733 (+ 7618us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.596761 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.596777 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:26:05.596809 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.596811 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.596855 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.596944 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.597886 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.603806 (+ 5920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.608801 (+ 4995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.609161 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.609264 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.610969 (+ 1705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.610972 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.610974 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.610995 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.612815 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.613418 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.613451 (+ 33us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.613453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.613592 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.613980 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.613984 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.613986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.614212 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.614338 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.615063 (+ 725us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.615225 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7544,"thread_start_us":90,"threads_started":1}
I20260809 02:26:05.617553 471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: NON_VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: true } } }
I20260809 02:26:05.617695 471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:05.620589 1227 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d: attempting to promote NON_VOTER fe0634cb74da4dd1ae30ed10da3896ae to VOTER
I20260809 02:26:05.620903 1227 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } }
I20260809 02:26:05.622103 532 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 1 LEARNER]: Refusing update from remote peer 3eedaf8b154b4549842034052633030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 02:26:05.622493 1231 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 02:26:05.624074 32720 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 FOLLOWER]: Refusing update from remote peer 3eedaf8b154b4549842034052633030d: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260809 02:26:05.624617 1231 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260809 02:26:05.624606 471 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, fe0634cb74da4dd1ae30ed10da3896ae (127.21.214.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } } }
I20260809 02:26:05.625116 532 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, fe0634cb74da4dd1ae30ed10da3896ae (127.21.214.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } } }
I20260809 02:26:05.625761 32720 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, fe0634cb74da4dd1ae30ed10da3896ae (127.21.214.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } } }
I20260809 02:26:05.626210 471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } } }
I20260809 02:26:05.626302 471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:05.626443 471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } } }
I20260809 02:26:05.626518 471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:05.626650 1026 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } } }
I20260809 02:26:05.626767 1026 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:26:05.627460 1243 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } } }
I20260809 02:26:05.627609 1243 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:26:05.630628 1231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3eedaf8b154b4549842034052633030d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } } }
I20260809 02:26:05.630743 1231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:05.636718 1024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.629250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:40687 (local address 127.0.0.1:55720)
0809 02:26:05.629403 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.629423 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.629486 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.631206 (+ 1720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.631212 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.631234 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:05.631354 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.631361 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.632919 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.632922 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.634328 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.634338 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.636205 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.636208 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.636351 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.636398 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.636479 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.636588 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"mutex_wait_us":150}
I20260809 02:26:05.636790 1246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.629727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55720 (local address 127.21.214.129:40687)
0809 02:26:05.630720 (+ 993us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.630734 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.630755 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:26:05.630850 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.630856 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.631019 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.631534 (+ 515us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:05.631885 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.632798 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.634496 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.636068 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.636209 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.636345 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.636519 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.636629 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":896,"thread_start_us":94,"threads_started":1}
I20260809 02:26:05.636874 1248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.630256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44506 (local address 127.21.214.130:45379)
0809 02:26:05.630630 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.630646 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.630672 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:26:05.630757 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.630763 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.630993 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.631213 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:05.631484 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.632921 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.634473 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.635333 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.635635 (+ 302us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.635777 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.636614 (+ 837us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.636713 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":142,"threads_started":1}
I20260809 02:26:05.637374 1244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.629392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:45379 (local address 127.0.0.1:44506)
0809 02:26:05.629661 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.629674 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.629757 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.631179 (+ 1422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.631182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.631202 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:05.631345 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.631351 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.633048 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.633051 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.634246 (+ 1195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.634258 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.635473 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.635479 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.636369 (+ 890us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.636429 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.636494 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.637278 (+ 784us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":1504,"thread_start_us":115,"threads_started":1}
I20260809 02:26:05.639477 1245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.629740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:41855 (local address 127.0.0.1:45064)
0809 02:26:05.629959 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.629975 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.630075 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.633602 (+ 3527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.633605 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.633623 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:05.633724 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.633730 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.635335 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.635338 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.637924 (+ 2586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.637934 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.639105 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.639109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.639200 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.639226 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.639279 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.639348 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":1347,"thread_start_us":93,"threads_started":1}
I20260809 02:26:05.640201 1247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.629920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45064 (local address 127.21.214.131:41855)
0809 02:26:05.633138 (+ 3218us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.633152 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.633178 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:26:05.633255 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.633260 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.633445 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.633892 (+ 447us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:05.634032 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.635200 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.638065 (+ 2865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.638955 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.639786 (+ 831us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.639919 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.639972 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.640064 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3038,"thread_start_us":112,"threads_started":1}
I20260809 02:26:05.640268 696 tablet_service.cc:1467] Processing CreateTablet for tablet d2cad40eef92487d9507e4cc58232c25 (DEFAULT_TABLE table=test-table [id=5cf1551091a6473a8526f014dd5b04fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:05.640355 893 tablet_service.cc:1467] Processing CreateTablet for tablet d2cad40eef92487d9507e4cc58232c25 (DEFAULT_TABLE table=test-table [id=5cf1551091a6473a8526f014dd5b04fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:05.641445 696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2cad40eef92487d9507e4cc58232c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:05.641525 893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2cad40eef92487d9507e4cc58232c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:05.643361 1099 tablet_service.cc:1467] Processing CreateTablet for tablet d2cad40eef92487d9507e4cc58232c25 (DEFAULT_TABLE table=test-table [id=5cf1551091a6473a8526f014dd5b04fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:05.644541 1099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2cad40eef92487d9507e4cc58232c25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:05.650077 1249 tablet_bootstrap.cc:492] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc: Bootstrap starting.
I20260809 02:26:05.652572 1249 tablet_bootstrap.cc:654] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:05.653617 1249 log.cc:824] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:05.653937 1251 tablet_bootstrap.cc:492] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6: Bootstrap starting.
I20260809 02:26:05.655869 1249 tablet_bootstrap.cc:492] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc: No bootstrap required, opened a new log
I20260809 02:26:05.656072 1249 ts_tablet_manager.cc:1397] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:26:05.656289 1251 tablet_bootstrap.cc:654] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:05.657145 1251 log.cc:824] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:05.658761 1250 tablet_bootstrap.cc:492] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1: Bootstrap starting.
I20260809 02:26:05.659255 1251 tablet_bootstrap.cc:492] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6: No bootstrap required, opened a new log
I20260809 02:26:05.659466 1251 ts_tablet_manager.cc:1397] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:26:05.660923 1250 tablet_bootstrap.cc:654] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:05.660815 1249 raft_consensus.cc:348] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } }
I20260809 02:26:05.661101 1249 raft_consensus.cc:374] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:05.661173 1249 raft_consensus.cc:729] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663a460229954475b4b523e589106efc, State: Initialized, Role: FOLLOWER
I20260809 02:26:05.661634 1249 consensus_queue.cc:260] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } }
I20260809 02:26:05.661834 1250 log.cc:824] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:05.662686 1249 ts_tablet_manager.cc:1428] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260809 02:26:05.663666 1250 tablet_bootstrap.cc:492] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1: No bootstrap required, opened a new log
I20260809 02:26:05.663904 1250 ts_tablet_manager.cc:1397] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:26:05.664350 1251 raft_consensus.cc:348] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } }
I20260809 02:26:05.664590 1251 raft_consensus.cc:374] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:05.664645 1251 raft_consensus.cc:729] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8988bbb9ebf40029d49a50e95639df6, State: Initialized, Role: FOLLOWER
I20260809 02:26:05.665082 1251 consensus_queue.cc:260] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } }
I20260809 02:26:05.665825 1197 heartbeater.cc:503] Master 127.21.214.190:44511 was elected leader, sending a full tablet report...
I20260809 02:26:05.665946 1251 ts_tablet_manager.cc:1428] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:26:05.668319 1250 raft_consensus.cc:348] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } }
I20260809 02:26:05.668571 1250 raft_consensus.cc:374] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:05.668627 1250 raft_consensus.cc:729] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20e3d7982964ac9be3d5e3c1866bfe1, State: Initialized, Role: FOLLOWER
I20260809 02:26:05.669020 1250 consensus_queue.cc:260] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } }
I20260809 02:26:05.669946 1250 ts_tablet_manager.cc:1428] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 02:26:05.670504 987 heartbeater.cc:503] Master 127.21.214.190:44511 was elected leader, sending a full tablet report...
I20260809 02:26:05.671201 792 heartbeater.cc:503] Master 127.21.214.190:44511 was elected leader, sending a full tablet report...
I20260809 02:26:05.745667 1263 raft_consensus.cc:482] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:26:05.746121 1263 raft_consensus.cc:504] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } }
I20260809 02:26:05.747714 1263 leader_election.cc:288] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 663a460229954475b4b523e589106efc (127.21.214.129:40687), b8988bbb9ebf40029d49a50e95639df6 (127.21.214.131:41855)
I20260809 02:26:05.751806 995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.747948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:40687 (local address 127.21.214.130:48605)
0809 02:26:05.748107 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.748125 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.748268 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.748552 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.748555 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.748586 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:05.748724 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.748729 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.749489 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.749494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.750444 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.750459 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.751321 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.751325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.751434 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.751463 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.751542 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.751615 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 02:26:05.752152 993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.748298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:41855 (local address 127.21.214.130:59403)
0809 02:26:05.748675 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:05.748690 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:05.748761 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:05.749028 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:05.749030 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:05.749060 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:05.749172 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.749178 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.749900 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.749905 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.750831 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:05.750843 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.751705 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.751709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:05.751819 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.751838 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 02:26:05.751939 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 02:26:05.752030 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301}
I20260809 02:26:05.752161 1246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.748131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:48605 (local address 127.21.214.129:40687)
0809 02:26:05.748305 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.748310 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.748328 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:26:05.748393 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.748397 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.748447 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.748534 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:05.748846 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.749372 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.750586 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.751197 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.751320 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.751390 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.751932 (+ 542us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.752026 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 02:26:05.752588 1247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.748524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:59403 (local address 127.21.214.131:41855)
0809 02:26:05.748729 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.748735 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.748749 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:26:05.748891 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.748893 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.748932 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.749015 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:05.749289 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.749779 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.750991 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.751589 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.751719 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.751765 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.752374 (+ 609us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.752456 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260809 02:26:05.752826 731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2cad40eef92487d9507e4cc58232c25" candidate_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663a460229954475b4b523e589106efc" is_pre_election: true
I20260809 02:26:05.753147 1124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2cad40eef92487d9507e4cc58232c25" candidate_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8988bbb9ebf40029d49a50e95639df6" is_pre_election: true
I20260809 02:26:05.753197 731 raft_consensus.cc:2454] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20e3d7982964ac9be3d5e3c1866bfe1 in term 0.
I20260809 02:26:05.753453 1124 raft_consensus.cc:2454] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20e3d7982964ac9be3d5e3c1866bfe1 in term 0.
I20260809 02:26:05.753697 821 leader_election.cc:302] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663a460229954475b4b523e589106efc, f20e3d7982964ac9be3d5e3c1866bfe1; no voters:
I20260809 02:26:05.754002 1263 raft_consensus.cc:2781] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:26:05.754109 1263 raft_consensus.cc:482] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:26:05.754158 1263 raft_consensus.cc:3037] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:05.755292 1263 raft_consensus.cc:504] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } }
I20260809 02:26:05.755650 1263 leader_election.cc:288] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [CANDIDATE]: Term 1 election: Requested vote from peers 663a460229954475b4b523e589106efc (127.21.214.129:40687), b8988bbb9ebf40029d49a50e95639df6 (127.21.214.131:41855)
I20260809 02:26:05.756029 731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2cad40eef92487d9507e4cc58232c25" candidate_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663a460229954475b4b523e589106efc"
I20260809 02:26:05.756059 1124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2cad40eef92487d9507e4cc58232c25" candidate_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8988bbb9ebf40029d49a50e95639df6"
I20260809 02:26:05.756172 731 raft_consensus.cc:3037] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:05.756214 1124 raft_consensus.cc:3037] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:05.757211 731 raft_consensus.cc:2454] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20e3d7982964ac9be3d5e3c1866bfe1 in term 1.
I20260809 02:26:05.757382 1124 raft_consensus.cc:2454] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20e3d7982964ac9be3d5e3c1866bfe1 in term 1.
I20260809 02:26:05.757566 821 leader_election.cc:302] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663a460229954475b4b523e589106efc, f20e3d7982964ac9be3d5e3c1866bfe1; no voters:
I20260809 02:26:05.757874 1263 raft_consensus.cc:2781] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:05.758162 1263 raft_consensus.cc:686] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 1 LEADER]: Becoming Leader. State: Replica: f20e3d7982964ac9be3d5e3c1866bfe1, State: Running, Role: LEADER
I20260809 02:26:05.758879 1263 consensus_queue.cc:237] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } }
I20260809 02:26:05.762706 31797 catalog_manager.cc:5495] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 reported cstate change: term changed from 0 to 1, leader changed from <none> to f20e3d7982964ac9be3d5e3c1866bfe1 (127.21.214.130). New cstate: current_term: 1 leader_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } health_report { overall_health: UNKNOWN } } }
I20260809 02:26:05.790685 1248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.787028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44516 (local address 127.21.214.130:45379)
0809 02:26:05.787191 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.787195 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.787208 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:26:05.787286 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.787288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.787342 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.787473 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:26:05.787730 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.788290 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.789180 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.789391 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.789502 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.789831 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:26:05.790263 (+ 432us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:26:05.790403 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.790481 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.790537 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 02:26:05.797041 731 raft_consensus.cc:1261] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc [term 1 FOLLOWER]: Refusing update from remote peer f20e3d7982964ac9be3d5e3c1866bfe1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:05.797041 1124 raft_consensus.cc:1261] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6 [term 1 FOLLOWER]: Refusing update from remote peer f20e3d7982964ac9be3d5e3c1866bfe1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:05.797879 1263 consensus_queue.cc:1035] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:05.798141 1264 consensus_queue.cc:1035] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:05.806919 1268 mvcc.cc:205] Tried to move back new op lower bound from 7316448730296475648 to 7316448730151305216. Current Snapshot: MvccSnapshot[applied={T|T < 7316448730296475648}]
I20260809 02:26:05.809432 1269 mvcc.cc:205] Tried to move back new op lower bound from 7316448730296475648 to 7316448730151305216. Current Snapshot: MvccSnapshot[applied={T|T < 7316448730296475648}]
I20260809 02:26:05.817441 31797 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:05.817647 31797 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:05.822289 31797 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3eedaf8b154b4549842034052633030d: Sending DeleteTablet for 3 replicas of tablet d2cad40eef92487d9507e4cc58232c25
I20260809 02:26:05.823068 696 tablet_service.cc:1514] Processing DeleteTablet for tablet d2cad40eef92487d9507e4cc58232c25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:05 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:55720
I20260809 02:26:05.823292 1099 tablet_service.cc:1514] Processing DeleteTablet for tablet d2cad40eef92487d9507e4cc58232c25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:05 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:45064
I20260809 02:26:05.823698 1281 tablet_replica.cc:330] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc: stopping tablet replica
I20260809 02:26:05.823987 893 tablet_service.cc:1514] Processing DeleteTablet for tablet d2cad40eef92487d9507e4cc58232c25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:05 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:44506
I20260809 02:26:05.824041 1281 raft_consensus.cc:2229] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:05.824396 1281 raft_consensus.cc:2258] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:05.825407 1282 tablet_replica.cc:330] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6: stopping tablet replica
I20260809 02:26:05.825726 1282 raft_consensus.cc:2229] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:05.826000 1282 raft_consensus.cc:2258] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:05.826159 1281 ts_tablet_manager.cc:1905] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:05.827656 1282 ts_tablet_manager.cc:1905] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:05.828088 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 31749
I20260809 02:26:05.838706 1281 ts_tablet_manager.cc:1918] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:26:05.838860 1281 log.cc:1196] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-0/wal/wals/d2cad40eef92487d9507e4cc58232c25
I20260809 02:26:05.839260 1281 ts_tablet_manager.cc:1939] T d2cad40eef92487d9507e4cc58232c25 P 663a460229954475b4b523e589106efc: Deleting consensus metadata
I20260809 02:26:05.839704 1282 ts_tablet_manager.cc:1918] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:26:05.839823 1282 log.cc:1196] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/d2cad40eef92487d9507e4cc58232c25
I20260809 02:26:05.840164 1282 ts_tablet_manager.cc:1939] T d2cad40eef92487d9507e4cc58232c25 P b8988bbb9ebf40029d49a50e95639df6: Deleting consensus metadata
I20260809 02:26:05.842974 1283 tablet_replica.cc:330] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1: stopping tablet replica
I20260809 02:26:05.843400 1283 raft_consensus.cc:2229] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:26:05.843875 1283 raft_consensus.cc:2258] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 02:26:05.845541 1019 connection.cc:535] server connection from 127.0.0.1:45064 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:26:05.845793 1283 ts_tablet_manager.cc:1905] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 02:26:05.846354 628 connection.cc:535] server connection from 127.0.0.1:55720 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:26:05.849241 1222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.826324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38204 (local address 127.21.214.189:40483)
0809 02:26:05.826598 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.826604 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.826632 (+ 28us) server_negotiation.cc:407] Connection header received
0809 02:26:05.837150 (+ 10518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.837160 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.837275 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.837409 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.840971 (+ 3562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.841735 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.842729 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.843069 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.843185 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.845219 (+ 2034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.845223 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.845226 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.845256 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.847196 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.847714 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.847718 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.847722 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.847822 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.848153 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.848157 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.848158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.848420 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.848548 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.848929 (+ 381us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.849071 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192}
I20260809 02:26:05.849609 1283 ts_tablet_manager.cc:1918] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:26:05.849701 1283 log.cc:1196] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/d2cad40eef92487d9507e4cc58232c25
I20260809 02:26:05.850099 1283 ts_tablet_manager.cc:1939] T d2cad40eef92487d9507e4cc58232c25 P f20e3d7982964ac9be3d5e3c1866bfe1: Deleting consensus metadata
W20260809 02:26:05.851311 822 connection.cc:441] server connection from 127.0.0.1:44506 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44506 (request call id 1) could send its response
I20260809 02:26:05.860841 1221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.826465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54512 (local address 127.21.214.188:38955)
0809 02:26:05.826738 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.826744 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.850558 (+ 23814us) server_negotiation.cc:407] Connection header received
0809 02:26:05.850834 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.850838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.850901 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.850957 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.851910 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.852715 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.853874 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.854234 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.854304 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.856086 (+ 1782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.856093 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.856099 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.856129 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.858767 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.859290 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.859294 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.859296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.859387 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.859731 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.859735 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.859737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.859997 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.860123 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.860495 (+ 372us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.860639 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190}
I20260809 02:26:05.861694 1222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.851905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38212 (local address 127.21.214.189:40483)
0809 02:26:05.852017 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.852022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.852413 (+ 391us) server_negotiation.cc:407] Connection header received
0809 02:26:05.852565 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.852568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.852606 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.852649 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.853591 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.854323 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.855564 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.855930 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.856020 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.857814 (+ 1794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.857819 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.857821 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.857848 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.859619 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.860337 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.860340 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.860342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.860433 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.860751 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.860754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.860756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.860966 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.861072 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.861439 (+ 367us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.861556 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:26:05.863925 798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:05.852916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54514 (local address 127.21.214.188:38955)
0809 02:26:05.853035 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:05.853040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:05.853783 (+ 743us) server_negotiation.cc:407] Connection header received
0809 02:26:05.854040 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:05.854044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:05.854089 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:05.854142 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:05.855280 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.856134 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.857490 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:05.857876 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:05.857953 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:05.859681 (+ 1728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:05.859686 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:05.859688 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:05.859716 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:05.861621 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.862873 (+ 1252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.862876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.862877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.862951 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:05.863248 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:05.863250 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:05.863252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:05.863395 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:05.863491 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:05.863738 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 02:26:05.863824 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:26:06.814507 1295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:06.813903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.131:54263)
0809 02:26:06.814253 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:06.814347 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":108,"threads_started":1}
W20260809 02:26:06.814883 1197 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:44511 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
I20260809 02:26:06.815019 1296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:06.814506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.130:48647)
0809 02:26:06.814818 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:06.814917 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":92,"threads_started":1}
W20260809 02:26:06.815349 987 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:44511 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
I20260809 02:26:06.817167 1299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:06.816718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.129:35585)
0809 02:26:06.816974 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:06.817066 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":77,"threads_started":1}
W20260809 02:26:06.817518 792 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:44511 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
I20260809 02:26:07.322994 1302 raft_consensus.cc:482] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3eedaf8b154b4549842034052633030d)
I20260809 02:26:07.323215 1302 raft_consensus.cc:504] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } }
I20260809 02:26:07.324184 1302 leader_election.cc:288] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eedaf8b154b4549842034052633030d (127.21.214.190:44511), fe0634cb74da4dd1ae30ed10da3896ae (127.21.214.188:38955)
I20260809 02:26:07.325024 1303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.324537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:40012)
0809 02:26:07.324787 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.324899 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":81,"threads_started":1}
I20260809 02:26:07.325028 1305 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3eedaf8b154b4549842034052633030d)
I20260809 02:26:07.325246 1305 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } }
W20260809 02:26:07.325400 32689 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
I20260809 02:26:07.326323 1303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.326060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:40018)
0809 02:26:07.326180 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.326252 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 02:26:07.326488 32689 leader_election.cc:334] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3eedaf8b154b4549842034052633030d (127.21.214.190:44511): Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
I20260809 02:26:07.326930 1310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.326350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:40028)
0809 02:26:07.326714 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.326826 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":74,"threads_started":1}
W20260809 02:26:07.327212 495 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
I20260809 02:26:07.328303 1310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.328021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:40054)
0809 02:26:07.328167 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.328228 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260809 02:26:07.326982 1305 leader_election.cc:288] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eedaf8b154b4549842034052633030d (127.21.214.190:44511), e20873ff3d1e4564ad945b14e17c51f3 (127.21.214.189:40483)
W20260809 02:26:07.328542 495 leader_election.cc:334] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3eedaf8b154b4549842034052633030d (127.21.214.190:44511): Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
I20260809 02:26:07.329937 1306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.324974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:38955 (local address 127.0.0.1:54516)
0809 02:26:07.325303 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.325319 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:07.325437 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:07.325869 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:07.325873 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:07.325919 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:07.326029 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.326036 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.327114 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.327120 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.328321 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.328331 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.329518 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.329522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.329619 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.329641 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 02:26:07.329742 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 02:26:07.329815 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":104,"threads_started":1}
I20260809 02:26:07.329937 1308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.325250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54516 (local address 127.21.214.188:38955)
0809 02:26:07.325476 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:07.325482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:07.325501 (+ 19us) server_negotiation.cc:407] Connection header received
0809 02:26:07.325557 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:07.325559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:07.325620 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:07.325725 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:07.326184 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.326995 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.328826 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.329387 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.329518 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.329645 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:07.329756 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 02:26:07.329826 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":158,"thread_start_us":58,"threads_started":1}
I20260809 02:26:07.330596 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e20873ff3d1e4564ad945b14e17c51f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" is_pre_election: true
I20260809 02:26:07.330799 532 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e20873ff3d1e4564ad945b14e17c51f3 in term 1.
I20260809 02:26:07.331132 32689 leader_election.cc:302] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e20873ff3d1e4564ad945b14e17c51f3, fe0634cb74da4dd1ae30ed10da3896ae; no voters: 3eedaf8b154b4549842034052633030d
I20260809 02:26:07.331365 1302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 02:26:07.331426 1302 raft_consensus.cc:482] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3eedaf8b154b4549842034052633030d)
I20260809 02:26:07.331467 1302 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:26:07.331990 1312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.326905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38222 (local address 127.21.214.189:40483)
0809 02:26:07.327289 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:07.327302 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:07.327665 (+ 363us) server_negotiation.cc:407] Connection header received
0809 02:26:07.327720 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:07.327723 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:07.327772 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:07.327860 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:07.328282 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.329086 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.330753 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.331400 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.331540 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.331587 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:07.331837 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 02:26:07.331900 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":118,"threads_started":1}
I20260809 02:26:07.332000 1311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.326822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40483 (local address 127.0.0.1:38222)
0809 02:26:07.327436 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.327455 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:07.327564 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:07.327997 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:07.328002 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:07.328022 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:07.328127 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.328134 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.329441 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.329444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.330607 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.330617 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.331571 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.331575 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.331706 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.331730 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:26:07.331814 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 02:26:07.331880 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":69,"threads_started":1}
I20260809 02:26:07.332613 32720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e20873ff3d1e4564ad945b14e17c51f3" is_pre_election: true
I20260809 02:26:07.332916 1302 raft_consensus.cc:504] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } }
I20260809 02:26:07.333154 32720 raft_consensus.cc:2379] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe0634cb74da4dd1ae30ed10da3896ae in current term 2: Already voted for candidate e20873ff3d1e4564ad945b14e17c51f3 in this term.
I20260809 02:26:07.333303 1302 leader_election.cc:288] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [CANDIDATE]: Term 2 election: Requested vote from peers 3eedaf8b154b4549842034052633030d (127.21.214.190:44511), fe0634cb74da4dd1ae30ed10da3896ae (127.21.214.188:38955)
I20260809 02:26:07.333598 489 leader_election.cc:302] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe0634cb74da4dd1ae30ed10da3896ae; no voters: 3eedaf8b154b4549842034052633030d, e20873ff3d1e4564ad945b14e17c51f3
I20260809 02:26:07.333691 1306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.333444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:40058)
0809 02:26:07.333573 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.333631 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 02:26:07.333976 1305 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:26:07.333920 532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e20873ff3d1e4564ad945b14e17c51f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "fe0634cb74da4dd1ae30ed10da3896ae"
I20260809 02:26:07.334394 1306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.334173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:40064)
0809 02:26:07.334287 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.334339 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 02:26:07.334518 32689 leader_election.cc:334] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3eedaf8b154b4549842034052633030d (127.21.214.190:44511): Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
I20260809 02:26:07.335114 1305 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:26:07.336024 532 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e20873ff3d1e4564ad945b14e17c51f3 in term 2.
I20260809 02:26:07.336486 32689 leader_election.cc:302] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e20873ff3d1e4564ad945b14e17c51f3, fe0634cb74da4dd1ae30ed10da3896ae; no voters: 3eedaf8b154b4549842034052633030d
I20260809 02:26:07.336709 1302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:26:07.336961 1302 raft_consensus.cc:686] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [term 2 LEADER]: Becoming Leader. State: Replica: e20873ff3d1e4564ad945b14e17c51f3, State: Running, Role: LEADER
I20260809 02:26:07.337293 1302 consensus_queue.cc:237] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } }
I20260809 02:26:07.338563 1315 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e20873ff3d1e4564ad945b14e17c51f3. Latest consensus state: current_term: 2 leader_uuid: "e20873ff3d1e4564ad945b14e17c51f3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } } }
I20260809 02:26:07.338696 1315 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:07.339013 1318 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:26:07.341441 1318 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:26:07.341892 1318 catalog_manager.cc:1259] Loaded cluster ID: eb48c3c31dc54750820198d28737ad6b
I20260809 02:26:07.341943 1318 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:26:07.342613 1318 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:26:07.343046 1318 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: Loaded TSK: 0
I20260809 02:26:07.343791 1318 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:26:07.385578 32708 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38212:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:26:07.388916 32708 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:26:07.392117 1306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.391854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:40074)
0809 02:26:07.391986 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.392038 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 02:26:07.392194 532 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [term 2 FOLLOWER]: Refusing update from remote peer e20873ff3d1e4564ad945b14e17c51f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260809 02:26:07.392854 1306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.392648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.0.0.1:40078)
0809 02:26:07.392749 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.392797 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 02:26:07.392897 1302 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260809 02:26:07.393059 32689 consensus_peers.cc:487] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 -> Peer 3eedaf8b154b4549842034052633030d (127.21.214.190:44511): Couldn't send request to peer 3eedaf8b154b4549842034052633030d. Status: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 02:26:07.394491 1305 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader e20873ff3d1e4564ad945b14e17c51f3. Latest consensus state: current_term: 2 leader_uuid: "e20873ff3d1e4564ad945b14e17c51f3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } } }
I20260809 02:26:07.394605 1305 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:26:07.395872 1302 sys_catalog.cc:455] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "e20873ff3d1e4564ad945b14e17c51f3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } } }
I20260809 02:26:07.395988 1302 sys_catalog.cc:458] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3 [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:07.396171 1305 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "e20873ff3d1e4564ad945b14e17c51f3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "3eedaf8b154b4549842034052633030d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44511 } } peers { permanent_uuid: "e20873ff3d1e4564ad945b14e17c51f3" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40483 } attrs { promote: false } } peers { permanent_uuid: "fe0634cb74da4dd1ae30ed10da3896ae" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 38955 } attrs { promote: false } } }
I20260809 02:26:07.396286 1305 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe0634cb74da4dd1ae30ed10da3896ae [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:26:07.407522 1306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.402649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:40687 (local address 127.0.0.1:55722)
0809 02:26:07.402742 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.402758 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:07.402839 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:07.403340 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:07.403343 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:07.403361 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:07.403470 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.403476 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.404517 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.404522 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.405747 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.405757 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.407126 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.407129 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.407219 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.407245 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:26:07.407321 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:26:07.407393 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 02:26:07.407801 1327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.402791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55722 (local address 127.21.214.129:40687)
0809 02:26:07.403097 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:07.403102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:07.403116 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:26:07.403172 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:07.403177 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:07.403233 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:07.403326 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:07.403637 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.404385 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.406509 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.406996 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.407135 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.407191 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:07.407378 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 02:26:07.407464 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":70,"threads_started":1}
I20260809 02:26:07.408486 696 tablet_service.cc:1467] Processing CreateTablet for tablet cceb0f88d51242fbbe1a83736de19b86 (DEFAULT_TABLE table=test-table [id=edbe775dba6347a08bf2df23fff2e35d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:07.408859 696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cceb0f88d51242fbbe1a83736de19b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:07.409221 1333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.404002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:45379 (local address 127.0.0.1:44526)
0809 02:26:07.404293 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.404306 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:07.404391 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:07.404753 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:07.404756 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:07.404772 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:07.404844 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.404848 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.405732 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.405735 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.407876 (+ 2141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.407887 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.408787 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.408791 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.408883 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.408912 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 02:26:07.408988 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:26:07.409072 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":127,"threads_started":1}
I20260809 02:26:07.409252 1303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.403031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:41855 (local address 127.0.0.1:45080)
0809 02:26:07.403128 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.403146 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:07.403247 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:07.404350 (+ 1103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:07.404354 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:07.404376 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:07.404527 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.404534 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.405581 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.405584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.407743 (+ 2159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.407756 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.408816 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.408820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.408937 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.408962 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:26:07.409033 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:26:07.409136 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 02:26:07.409298 1332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.403427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45080 (local address 127.21.214.131:41855)
0809 02:26:07.403725 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:07.403729 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:07.403743 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:26:07.403805 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:07.403808 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:07.403855 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:07.403942 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:07.404649 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.405447 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.407893 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.408550 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.408675 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.408749 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:07.409066 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 02:26:07.409155 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":95,"threads_started":1}
I20260809 02:26:07.409705 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.404124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44526 (local address 127.21.214.130:45379)
0809 02:26:07.404388 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:07.404393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:07.404409 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:26:07.404467 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:07.404470 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:07.404524 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:07.404627 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:07.404976 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.405604 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.408031 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.408663 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.408789 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.408836 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:07.409490 (+ 654us) server_negotiation.cc:299] Negotiation successful
0809 02:26:07.409578 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":104,"threads_started":1}
I20260809 02:26:07.409894 1099 tablet_service.cc:1467] Processing CreateTablet for tablet cceb0f88d51242fbbe1a83736de19b86 (DEFAULT_TABLE table=test-table [id=edbe775dba6347a08bf2df23fff2e35d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:07.410184 1099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cceb0f88d51242fbbe1a83736de19b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:07.411073 893 tablet_service.cc:1467] Processing CreateTablet for tablet cceb0f88d51242fbbe1a83736de19b86 (DEFAULT_TABLE table=test-table [id=edbe775dba6347a08bf2df23fff2e35d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:07.411361 893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cceb0f88d51242fbbe1a83736de19b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:07.411796 1335 tablet_bootstrap.cc:492] T cceb0f88d51242fbbe1a83736de19b86 P 663a460229954475b4b523e589106efc: Bootstrap starting.
I20260809 02:26:07.412810 1335 tablet_bootstrap.cc:654] T cceb0f88d51242fbbe1a83736de19b86 P 663a460229954475b4b523e589106efc: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:07.412827 1337 tablet_bootstrap.cc:492] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6: Bootstrap starting.
I20260809 02:26:07.413740 1337 tablet_bootstrap.cc:654] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:07.413947 1339 tablet_bootstrap.cc:492] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1: Bootstrap starting.
I20260809 02:26:07.414135 1335 tablet_bootstrap.cc:492] T cceb0f88d51242fbbe1a83736de19b86 P 663a460229954475b4b523e589106efc: No bootstrap required, opened a new log
I20260809 02:26:07.414238 1335 ts_tablet_manager.cc:1397] T cceb0f88d51242fbbe1a83736de19b86 P 663a460229954475b4b523e589106efc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:26:07.414759 1335 raft_consensus.cc:348] T cceb0f88d51242fbbe1a83736de19b86 P 663a460229954475b4b523e589106efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } }
I20260809 02:26:07.414891 1335 raft_consensus.cc:374] T cceb0f88d51242fbbe1a83736de19b86 P 663a460229954475b4b523e589106efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:07.414928 1335 raft_consensus.cc:729] T cceb0f88d51242fbbe1a83736de19b86 P 663a460229954475b4b523e589106efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 663a460229954475b4b523e589106efc, State: Initialized, Role: FOLLOWER
I20260809 02:26:07.415091 1335 consensus_queue.cc:260] T cceb0f88d51242fbbe1a83736de19b86 P 663a460229954475b4b523e589106efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } }
I20260809 02:26:07.415167 1339 tablet_bootstrap.cc:654] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:07.415426 1337 tablet_bootstrap.cc:492] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6: No bootstrap required, opened a new log
I20260809 02:26:07.415455 1335 ts_tablet_manager.cc:1428] T cceb0f88d51242fbbe1a83736de19b86 P 663a460229954475b4b523e589106efc: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 02:26:07.415517 1337 ts_tablet_manager.cc:1397] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:26:07.415926 1337 raft_consensus.cc:348] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } }
I20260809 02:26:07.416042 1337 raft_consensus.cc:374] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:07.416081 1337 raft_consensus.cc:729] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8988bbb9ebf40029d49a50e95639df6, State: Initialized, Role: FOLLOWER
I20260809 02:26:07.416258 1337 consensus_queue.cc:260] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } }
I20260809 02:26:07.417461 1337 ts_tablet_manager.cc:1428] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:26:07.417861 1347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.417240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.131:41395)
0809 02:26:07.417676 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.417748 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":96,"threads_started":1}
I20260809 02:26:07.418428 1339 tablet_bootstrap.cc:492] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1: No bootstrap required, opened a new log
I20260809 02:26:07.418529 1339 ts_tablet_manager.cc:1397] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 02:26:07.418877 1348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.418477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.131:58599)
0809 02:26:07.418723 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.418786 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":93,"threads_started":1}
I20260809 02:26:07.418979 1339 raft_consensus.cc:348] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } }
I20260809 02:26:07.419100 1339 raft_consensus.cc:374] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:07.419142 1339 raft_consensus.cc:729] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20e3d7982964ac9be3d5e3c1866bfe1, State: Initialized, Role: FOLLOWER
I20260809 02:26:07.419266 1339 consensus_queue.cc:260] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } }
I20260809 02:26:07.419612 1339 ts_tablet_manager.cc:1428] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:26:07.419850 1345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.415896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.129:48601)
0809 02:26:07.419631 (+ 3735us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.419744 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3638,"thread_start_us":118,"threads_started":1}
I20260809 02:26:07.419919 793 heartbeater.cc:503] Master 127.21.214.189:40483 was elected leader, sending a full tablet report...
I20260809 02:26:07.420935 1345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.420650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.129:40751)
0809 02:26:07.420811 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.420871 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 02:26:07.421154 1351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.420733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.130:55773)
0809 02:26:07.420990 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.421051 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":123,"threads_started":1}
I20260809 02:26:07.421612 1200 heartbeater.cc:503] Master 127.21.214.189:40483 was elected leader, sending a full tablet report...
I20260809 02:26:07.422890 1351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.422683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.130:41499)
0809 02:26:07.422766 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.422821 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260809 02:26:07.423535 988 heartbeater.cc:503] Master 127.21.214.189:40483 was elected leader, sending a full tablet report...
I20260809 02:26:07.479389 1346 raft_consensus.cc:482] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:26:07.479554 1346 raft_consensus.cc:504] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } }
I20260809 02:26:07.480763 1346 leader_election.cc:288] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 663a460229954475b4b523e589106efc (127.21.214.129:40687), f20e3d7982964ac9be3d5e3c1866bfe1 (127.21.214.130:45379)
I20260809 02:26:07.485453 1334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.481206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:36347 (local address 127.21.214.130:45379)
0809 02:26:07.481345 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:07.481351 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:07.481521 (+ 170us) server_negotiation.cc:407] Connection header received
0809 02:26:07.481690 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:07.481692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:07.481735 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:07.481838 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:07.482165 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.482683 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.484119 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.484802 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.484920 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.484962 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:07.485234 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 02:26:07.485325 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:26:07.485453 1327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.481193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:57821 (local address 127.21.214.129:40687)
0809 02:26:07.481337 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:07.481342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:07.481473 (+ 131us) server_negotiation.cc:407] Connection header received
0809 02:26:07.481634 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:07.481639 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:07.481703 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:07.481763 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:07.482118 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.482719 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.484006 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.484678 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.484800 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.484874 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:07.485267 (+ 393us) server_negotiation.cc:299] Negotiation successful
0809 02:26:07.485347 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:26:07.485487 1348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.481062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:45379 (local address 127.21.214.131:36347)
0809 02:26:07.481383 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.481404 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:07.481545 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:07.481875 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:07.481877 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:07.481893 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:07.482016 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.482020 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.482789 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.482796 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.483936 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.483948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.484911 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.484914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.485015 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.485086 (+ 71us) client_negotiation.cc:769] Sending connection context
0809 02:26:07.485188 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 02:26:07.485291 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"mutex_wait_us":173}
I20260809 02:26:07.485487 1347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.481062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:40687 (local address 127.21.214.131:57821)
0809 02:26:07.481352 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.481368 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:07.481510 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:07.481810 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:07.481815 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:07.481835 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:07.481996 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.482003 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.482860 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.482862 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.483829 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:07.483893 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.484833 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.484836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:07.484986 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.485086 (+ 100us) client_negotiation.cc:769] Sending connection context
0809 02:26:07.485226 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 02:26:07.485291 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":30}
I20260809 02:26:07.486304 731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cceb0f88d51242fbbe1a83736de19b86" candidate_uuid: "b8988bbb9ebf40029d49a50e95639df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663a460229954475b4b523e589106efc" is_pre_election: true
I20260809 02:26:07.486498 731 raft_consensus.cc:2454] T cceb0f88d51242fbbe1a83736de19b86 P 663a460229954475b4b523e589106efc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8988bbb9ebf40029d49a50e95639df6 in term 0.
I20260809 02:26:07.486609 924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cceb0f88d51242fbbe1a83736de19b86" candidate_uuid: "b8988bbb9ebf40029d49a50e95639df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" is_pre_election: true
I20260809 02:26:07.486922 924 raft_consensus.cc:2454] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8988bbb9ebf40029d49a50e95639df6 in term 0.
I20260809 02:26:07.486924 1022 leader_election.cc:302] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663a460229954475b4b523e589106efc, b8988bbb9ebf40029d49a50e95639df6; no voters:
I20260809 02:26:07.487210 1346 raft_consensus.cc:2781] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:26:07.487278 1346 raft_consensus.cc:482] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:26:07.487320 1346 raft_consensus.cc:3037] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:07.488389 1346 raft_consensus.cc:504] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } }
I20260809 02:26:07.488749 1346 leader_election.cc:288] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [CANDIDATE]: Term 1 election: Requested vote from peers 663a460229954475b4b523e589106efc (127.21.214.129:40687), f20e3d7982964ac9be3d5e3c1866bfe1 (127.21.214.130:45379)
I20260809 02:26:07.489141 731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cceb0f88d51242fbbe1a83736de19b86" candidate_uuid: "b8988bbb9ebf40029d49a50e95639df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "663a460229954475b4b523e589106efc"
I20260809 02:26:07.489262 731 raft_consensus.cc:3037] T cceb0f88d51242fbbe1a83736de19b86 P 663a460229954475b4b523e589106efc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:07.489286 924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cceb0f88d51242fbbe1a83736de19b86" candidate_uuid: "b8988bbb9ebf40029d49a50e95639df6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1"
I20260809 02:26:07.489472 924 raft_consensus.cc:3037] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:07.490185 731 raft_consensus.cc:2454] T cceb0f88d51242fbbe1a83736de19b86 P 663a460229954475b4b523e589106efc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8988bbb9ebf40029d49a50e95639df6 in term 1.
I20260809 02:26:07.490513 1022 leader_election.cc:302] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 663a460229954475b4b523e589106efc, b8988bbb9ebf40029d49a50e95639df6; no voters:
I20260809 02:26:07.490701 1346 raft_consensus.cc:2781] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:07.490828 924 raft_consensus.cc:2454] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8988bbb9ebf40029d49a50e95639df6 in term 1.
I20260809 02:26:07.490959 1346 raft_consensus.cc:686] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [term 1 LEADER]: Becoming Leader. State: Replica: b8988bbb9ebf40029d49a50e95639df6, State: Running, Role: LEADER
I20260809 02:26:07.491243 1346 consensus_queue.cc:237] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } }
I20260809 02:26:07.491665 1347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.491391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.131:42003)
0809 02:26:07.491542 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.491596 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 02:26:07.493811 32708 catalog_manager.cc:5495] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8988bbb9ebf40029d49a50e95639df6 (127.21.214.131). New cstate: current_term: 1 leader_uuid: "b8988bbb9ebf40029d49a50e95639df6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8988bbb9ebf40029d49a50e95639df6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 41855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 } health_report { overall_health: UNKNOWN } } }
I20260809 02:26:07.512111 1332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.508398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45096 (local address 127.21.214.131:41855)
0809 02:26:07.508533 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:07.508536 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:07.508550 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:26:07.508654 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:07.508656 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:07.508711 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:07.508797 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:26:07.509005 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.509530 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.510359 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:07.510655 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:07.510741 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:07.511129 (+ 388us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:26:07.511666 (+ 537us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:26:07.511831 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:07.511900 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 02:26:07.511959 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:26:07.515408 924 raft_consensus.cc:1261] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 1 FOLLOWER]: Refusing update from remote peer b8988bbb9ebf40029d49a50e95639df6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:07.515834 731 raft_consensus.cc:1261] T cceb0f88d51242fbbe1a83736de19b86 P 663a460229954475b4b523e589106efc [term 1 FOLLOWER]: Refusing update from remote peer b8988bbb9ebf40029d49a50e95639df6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:07.516155 1346 consensus_queue.cc:1035] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20e3d7982964ac9be3d5e3c1866bfe1" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 45379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:07.516475 1352 consensus_queue.cc:1035] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "663a460229954475b4b523e589106efc" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:07.518335 1351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.518052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.130:34569)
0809 02:26:07.518193 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.518265 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 02:26:07.521051 1345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.520787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.129:33333)
0809 02:26:07.520889 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.520970 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 02:26:07.525825 1351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.525451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.130:51191)
0809 02:26:07.525670 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.525733 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260809 02:26:07.527290 1345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.527070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.129:42411)
0809 02:26:07.527167 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.527218 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260809 02:26:07.529266 1347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.528890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44511 (local address 127.21.214.131:33217)
0809 02:26:07.529135 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.529194 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:44511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167}
I20260809 02:26:07.532226 32706 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:07.532368 32706 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:07.536968 32706 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e20873ff3d1e4564ad945b14e17c51f3: Sending DeleteTablet for 3 replicas of tablet cceb0f88d51242fbbe1a83736de19b86
I20260809 02:26:07.538018 893 tablet_service.cc:1514] Processing DeleteTablet for tablet cceb0f88d51242fbbe1a83736de19b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:07 UTC) from {username='oryx', principal='oryx/127.21.214.189@KRBTEST.COM'} at 127.0.0.1:44526
I20260809 02:26:07.538064 696 tablet_service.cc:1514] Processing DeleteTablet for tablet cceb0f88d51242fbbe1a83736de19b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:07 UTC) from {username='oryx', principal='oryx/127.21.214.189@KRBTEST.COM'} at 127.0.0.1:55722
I20260809 02:26:07.538563 1099 tablet_service.cc:1514] Processing DeleteTablet for tablet cceb0f88d51242fbbe1a83736de19b86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:07 UTC) from {username='oryx', principal='oryx/127.21.214.189@KRBTEST.COM'} at 127.0.0.1:45080
I20260809 02:26:07.538651 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 454
I20260809 02:26:07.545850 1375 tablet_replica.cc:330] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6: stopping tablet replica
I20260809 02:26:07.545960 1371 tablet_replica.cc:330] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1: stopping tablet replica
I20260809 02:26:07.546002 1375 raft_consensus.cc:2229] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:26:07.546073 1371 raft_consensus.cc:2229] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:07.546201 1371 raft_consensus.cc:2258] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:07.546340 1375 raft_consensus.cc:2258] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:07.547154 1371 ts_tablet_manager.cc:1905] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:07.547154 1375 ts_tablet_manager.cc:1905] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:07.549952 1375 ts_tablet_manager.cc:1918] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:26:07.549952 1371 ts_tablet_manager.cc:1918] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:26:07.550029 1371 log.cc:1196] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/cceb0f88d51242fbbe1a83736de19b86
I20260809 02:26:07.550271 1375 log.cc:1196] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/cceb0f88d51242fbbe1a83736de19b86
I20260809 02:26:07.550339 1371 ts_tablet_manager.cc:1939] T cceb0f88d51242fbbe1a83736de19b86 P f20e3d7982964ac9be3d5e3c1866bfe1: Deleting consensus metadata
I20260809 02:26:07.550607 1375 ts_tablet_manager.cc:1939] T cceb0f88d51242fbbe1a83736de19b86 P b8988bbb9ebf40029d49a50e95639df6: Deleting consensus metadata
I20260809 02:26:07.551182 32690 catalog_manager.cc:4841] TS f20e3d7982964ac9be3d5e3c1866bfe1 (127.21.214.130:45379): tablet cceb0f88d51242fbbe1a83736de19b86 (table test-table [id=edbe775dba6347a08bf2df23fff2e35d]) successfully deleted
I20260809 02:26:07.551257 32689 catalog_manager.cc:4841] TS b8988bbb9ebf40029d49a50e95639df6 (127.21.214.131:41855): tablet cceb0f88d51242fbbe1a83736de19b86 (table test-table [id=edbe775dba6347a08bf2df23fff2e35d]) successfully deleted
I20260809 02:26:07.556645 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 799
I20260809 02:26:07.556888 1333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:07.556570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:40687 (local address 127.0.0.1:55728)
0809 02:26:07.556737 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:07.556800 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:40687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260809 02:26:07.560559 32689 catalog_manager.cc:4584] TS 663a460229954475b4b523e589106efc (127.21.214.129:40687): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cceb0f88d51242fbbe1a83736de19b86: Network error: Client connection negotiation failed: client connection to 127.21.214.129:40687: connect: Connection refused (error 111)
I20260809 02:26:07.570076 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 997
I20260809 02:26:07.581382 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 32500
I20260809 02:26:07.592464 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 32659
2026-08-09T02:26:07Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5726 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:26:07 dist-test-slave-68xk krb5kdc[1380](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:26:07 dist-test-slave-68xk krb5kdc[1380](info): set up 2 sockets
Aug 09 02:26:07 dist-test-slave-68xk krb5kdc[1380](info): commencing operation
krb5kdc: starting...
W20260809 02:26:08.824378 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:26:08 dist-test-slave-68xk krb5kdc[1380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:26:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:26:08Z Disabled control of system clock
WARNING: no policy specified for oryx/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.190.keytab.
Entry for principal oryx/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.190.keytab.
I20260809 02:26:08.962255 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:40073
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.190.keytab
--principal=oryx/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:41497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:40073
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:09.078233 1403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:09.078557 1403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:09.078604 1403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:09.082568 1403 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:26:09.082623 1403 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 02:26:09.082646 1403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:09.082665 1403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:09.082681 1403 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:26:09.082697 1403 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:26:09.087992 1403 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:40073
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.190.keytab
--principal=oryx/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:40073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1403
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:09.088992 1403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:09.089959 1403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:09.098464 1409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:09.098614 1410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:09.098449 1413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:09.098755 1403 server_base.cc:1034] running on GCE node
I20260809 02:26:09.099337 1403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:09.100399 1403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:09.101583 1403 hybrid_clock.cc:648] HybridClock initialized: now 1786242369101556 us; error 46 us; skew 500 ppm
Aug 09 02:26:09 dist-test-slave-68xk krb5kdc[1380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242369, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:09.107887 1403 init.cc:377] Logged in from keytab as oryx/127.21.214.190@KRBTEST.COM (short username oryx)
I20260809 02:26:09.108922 1403 webserver.cc:460] Webserver started at http://127.21.214.190:42431/ using document root <none> and password file <none>
I20260809 02:26:09.109529 1403 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:09.109620 1403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:09.109859 1403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:09.112025 1403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "48ad0c41a8084732a5ae0d24d4d72b2e"
format_stamp: "Formatted at 2026-08-09 02:26:09 on dist-test-slave-68xk"
server_key: "77f0453520f5bf51dfc14979a67c4857"
server_key_iv: "b8e21e5782d3798309aadf2735196ab8"
server_key_version: "encryptionkey@0"
I20260809 02:26:09.112612 1403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "48ad0c41a8084732a5ae0d24d4d72b2e"
format_stamp: "Formatted at 2026-08-09 02:26:09 on dist-test-slave-68xk"
server_key: "77f0453520f5bf51dfc14979a67c4857"
server_key_iv: "b8e21e5782d3798309aadf2735196ab8"
server_key_version: "encryptionkey@0"
I20260809 02:26:09.116439 1403 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260809 02:26:09.119046 1422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:09.120386 1403 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:26:09.120524 1403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "48ad0c41a8084732a5ae0d24d4d72b2e"
format_stamp: "Formatted at 2026-08-09 02:26:09 on dist-test-slave-68xk"
server_key: "77f0453520f5bf51dfc14979a67c4857"
server_key_iv: "b8e21e5782d3798309aadf2735196ab8"
server_key_version: "encryptionkey@0"
I20260809 02:26:09.120635 1403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:09.136576 1403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:09.139984 1403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:09.140208 1403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:09.148594 1403 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:40073
I20260809 02:26:09.148690 1517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:40073 every 8 connection(s)
I20260809 02:26:09.149672 1403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:26:09.152560 1519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:09.158120 1519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e: Bootstrap starting.
I20260809 02:26:09.159356 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 1403
I20260809 02:26:09.159497 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:26:09.159802 22362 external_mini_cluster.cc:1428] Setting key 5dda6f1f0adf957bf5eb63538c56627d
I20260809 02:26:09.160986 1519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:09.161947 1519 log.cc:824] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:09.164230 1519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e: No bootstrap required, opened a new log
I20260809 02:26:09.168437 1519 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48ad0c41a8084732a5ae0d24d4d72b2e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40073 } }
I20260809 02:26:09.168669 1519 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:09.168748 1519 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48ad0c41a8084732a5ae0d24d4d72b2e, State: Initialized, Role: FOLLOWER
Aug 09 02:26:09 dist-test-slave-68xk krb5kdc[1380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
I20260809 02:26:09.169226 1519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48ad0c41a8084732a5ae0d24d4d72b2e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40073 } }
I20260809 02:26:09.169373 1519 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:26:09.169456 1519 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:26:09.169561 1519 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:09.170780 1519 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48ad0c41a8084732a5ae0d24d4d72b2e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40073 } }
I20260809 02:26:09.171180 1519 leader_election.cc:302] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48ad0c41a8084732a5ae0d24d4d72b2e; no voters:
I20260809 02:26:09.171553 1519 leader_election.cc:288] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:26:09.171705 1525 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:09.171958 1525 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [term 1 LEADER]: Becoming Leader. State: Replica: 48ad0c41a8084732a5ae0d24d4d72b2e, State: Running, Role: LEADER
I20260809 02:26:09.172255 1525 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48ad0c41a8084732a5ae0d24d4d72b2e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40073 } }
I20260809 02:26:09.172845 1519 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:26:09.174242 1528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48ad0c41a8084732a5ae0d24d4d72b2e. Latest consensus state: current_term: 1 leader_uuid: "48ad0c41a8084732a5ae0d24d4d72b2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48ad0c41a8084732a5ae0d24d4d72b2e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40073 } } }
I20260809 02:26:09.174379 1528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:09.174242 1529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48ad0c41a8084732a5ae0d24d4d72b2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48ad0c41a8084732a5ae0d24d4d72b2e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40073 } } }
I20260809 02:26:09.174754 1529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:09.176198 1523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.160946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49702 (local address 127.21.214.190:40073)
0809 02:26:09.161449 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.161469 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.161512 (+ 43us) server_negotiation.cc:407] Connection header received
0809 02:26:09.162352 (+ 840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.162376 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.162777 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.163147 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:09.163842 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.165322 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.166201 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.166941 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.167116 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.169835 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:09.169844 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:09.169861 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:09.169891 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:09.172214 (+ 2323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.172776 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.172782 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.172787 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.172934 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.173263 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.173266 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.173268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.173799 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:09.173991 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:09.174943 (+ 952us) server_negotiation.cc:299] Negotiation successful
0809 02:26:09.175255 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":155,"threads_started":1}
W20260809 02:26:09.177762 1544 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:26:09.177853 1544 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:26:09.177932 1540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:26:09.178900 1540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:26:09.184477 1540 catalog_manager.cc:1347] Generated new cluster ID: df6140141c604f1182bb6996acd78a93
I20260809 02:26:09.184564 1540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:26:09.197321 1540 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:26:09.198195 1540 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:26:09.207661 1540 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e: Generated new TSK 0
I20260809 02:26:09.208335 1540 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab.
Entry for principal oryx/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab.
I20260809 02:26:09.245471 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40073
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab
--principal=oryx/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:41497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:09.361164 1555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:09.361400 1555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:09.361442 1555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:09.365382 1555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:09.365440 1555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:09.365478 1555 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:26:09.365540 1555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:26:09.370620 1555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab
--principal=oryx/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.214.190:40073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:09.371750 1555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:09.372814 1555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:09.382901 1562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:09.382907 1564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:09.382925 1567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:09.383455 1555 server_base.cc:1034] running on GCE node
I20260809 02:26:09.383882 1555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:09.384526 1555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:09.385694 1555 hybrid_clock.cc:648] HybridClock initialized: now 1786242369385660 us; error 48 us; skew 500 ppm
Aug 09 02:26:09 dist-test-slave-68xk krb5kdc[1380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242369, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:09.388603 1555 init.cc:377] Logged in from keytab as oryx/127.21.214.129@KRBTEST.COM (short username oryx)
I20260809 02:26:09.389474 1555 webserver.cc:460] Webserver started at http://127.21.214.129:43109/ using document root <none> and password file <none>
I20260809 02:26:09.390023 1555 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:09.390084 1555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:09.390319 1555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:09.392365 1555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "ea99a65250d8470fb8fcee259b37ee17"
format_stamp: "Formatted at 2026-08-09 02:26:09 on dist-test-slave-68xk"
server_key: "3a53f500bb873c4ab13aa6d19d823043"
server_key_iv: "a52ce26aa2a25c42643694997d6bb09c"
server_key_version: "encryptionkey@0"
I20260809 02:26:09.392938 1555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "ea99a65250d8470fb8fcee259b37ee17"
format_stamp: "Formatted at 2026-08-09 02:26:09 on dist-test-slave-68xk"
server_key: "3a53f500bb873c4ab13aa6d19d823043"
server_key_iv: "a52ce26aa2a25c42643694997d6bb09c"
server_key_version: "encryptionkey@0"
I20260809 02:26:09.396740 1555 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 02:26:09.399250 1581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:09.400542 1555 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:26:09.400689 1555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "ea99a65250d8470fb8fcee259b37ee17"
format_stamp: "Formatted at 2026-08-09 02:26:09 on dist-test-slave-68xk"
server_key: "3a53f500bb873c4ab13aa6d19d823043"
server_key_iv: "a52ce26aa2a25c42643694997d6bb09c"
server_key_version: "encryptionkey@0"
I20260809 02:26:09.400797 1555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:09.413079 1555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:09.416038 1555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:09.416245 1555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:09.417706 1555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:09.417776 1555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:09.417843 1555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:09.417891 1555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:09.429093 1555 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:46205
Aug 09 02:26:09 dist-test-slave-68xk krb5kdc[1380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242369, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
I20260809 02:26:09.429162 1754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:46205 every 8 connection(s)
I20260809 02:26:09.430099 1555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:26:09.432262 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 1555
I20260809 02:26:09.432422 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:26:09.432749 22362 external_mini_cluster.cc:1428] Setting key 1079df2a91ad16609b108cfbb7a81a69
I20260809 02:26:09.433743 1523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.418825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:57093 (local address 127.21.214.190:40073)
0809 02:26:09.418976 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.418980 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.420118 (+ 1138us) server_negotiation.cc:407] Connection header received
0809 02:26:09.421447 (+ 1329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.421452 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.421512 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.421571 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:09.423530 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.424437 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.426375 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.426795 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.426937 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.429824 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:09.429828 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:09.429831 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:09.429861 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:09.431546 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.432044 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.432050 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.432052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.432153 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.432589 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.432593 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.432595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.432813 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:09.432923 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:09.433505 (+ 582us) server_negotiation.cc:299] Negotiation successful
0809 02:26:09.433611 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:26:09.434607 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.419356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40073 (local address 127.21.214.129:57093)
0809 02:26:09.419910 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:09.419961 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:09.421185 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:09.421969 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:09.421978 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:09.422559 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:09.423333 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.423360 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.424602 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.424606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.426228 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.426240 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.427017 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.427024 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.427252 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.427913 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:09.427932 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:09.429641 (+ 1709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:09.431658 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:09.431662 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:09.431673 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:09.431921 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:09.432255 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:09.432257 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:09.432258 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:09.432467 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:09.432934 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:09.432942 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:09.433213 (+ 271us) client_negotiation.cc:769] Sending connection context
0809 02:26:09.433436 (+ 223us) client_negotiation.cc:240] Negotiation successful
0809 02:26:09.433704 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":154,"threads_started":1}
I20260809 02:26:09.436074 1759 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40073
I20260809 02:26:09.436261 1759 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:09.436825 1759 heartbeater.cc:511] Master 127.21.214.190:40073 requested a full tablet report, sending...
I20260809 02:26:09.438527 1447 ts_manager.cc:194] Registered new tserver with Master: ea99a65250d8470fb8fcee259b37ee17 (127.21.214.129:46205)
I20260809 02:26:09.439779 1447 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:57093
WARNING: no policy specified for oryx/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:26:09.448596 1523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.440334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:36077 (local address 127.21.214.190:40073)
0809 02:26:09.440484 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.440487 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.440498 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:26:09.440527 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.440529 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.440562 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.440757 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:09.441369 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.442256 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.443134 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.443551 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.443677 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.444783 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:09.444787 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:09.444791 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:09.444817 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:09.446682 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.447219 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.447226 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.447230 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.447329 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.447658 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.447661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.447662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.447855 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:09.447955 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:09.448353 (+ 398us) server_negotiation.cc:299] Negotiation successful
0809 02:26:09.448466 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:26:09.448627 1768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.438214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40073 (local address 127.21.214.129:36077)
0809 02:26:09.438508 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:09.438520 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:09.438589 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:09.440878 (+ 2289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:09.440881 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:09.441102 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:09.441226 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.441233 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.442447 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.442454 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.443007 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.443015 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.443691 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.443694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.443765 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.444309 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:09.444321 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:09.444632 (+ 311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:09.446805 (+ 2173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:09.446808 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:09.446809 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:09.447038 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:09.447435 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:09.447437 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:09.447439 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:09.447528 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:09.447968 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:09.447998 (+ 30us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:09.448144 (+ 146us) client_negotiation.cc:769] Sending connection context
0809 02:26:09.448284 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 02:26:09.448424 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":115,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab.
Entry for principal oryx/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab.
I20260809 02:26:09.469472 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40073
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab
--principal=oryx/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:41497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:09.580919 1770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:09.581182 1770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:09.581255 1770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:09.585230 1770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:09.585315 1770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:09.585383 1770 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:26:09.585465 1770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:26:09.590723 1770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab
--principal=oryx/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.214.190:40073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:09.591775 1770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:09.592808 1770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:09.602605 1781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:09.602605 1778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:09.602686 1777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:09.602953 1770 server_base.cc:1034] running on GCE node
I20260809 02:26:09.603361 1770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:09.604125 1770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:09.605320 1770 hybrid_clock.cc:648] HybridClock initialized: now 1786242369605289 us; error 50 us; skew 500 ppm
Aug 09 02:26:09 dist-test-slave-68xk krb5kdc[1380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242369, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:09.608336 1770 init.cc:377] Logged in from keytab as oryx/127.21.214.130@KRBTEST.COM (short username oryx)
I20260809 02:26:09.609201 1770 webserver.cc:460] Webserver started at http://127.21.214.130:36717/ using document root <none> and password file <none>
I20260809 02:26:09.609791 1770 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:09.609886 1770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:09.610126 1770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:09.612259 1770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "b43358821f374f6a8e9526e3088afa6d"
format_stamp: "Formatted at 2026-08-09 02:26:09 on dist-test-slave-68xk"
server_key: "dca594aa564093c7a8be3bc82a2ca58e"
server_key_iv: "f07274d162056dd0af500465a7267367"
server_key_version: "encryptionkey@0"
I20260809 02:26:09.612838 1770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "b43358821f374f6a8e9526e3088afa6d"
format_stamp: "Formatted at 2026-08-09 02:26:09 on dist-test-slave-68xk"
server_key: "dca594aa564093c7a8be3bc82a2ca58e"
server_key_iv: "f07274d162056dd0af500465a7267367"
server_key_version: "encryptionkey@0"
I20260809 02:26:09.616712 1770 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:26:09.619292 1796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:09.620639 1770 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:26:09.620791 1770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "b43358821f374f6a8e9526e3088afa6d"
format_stamp: "Formatted at 2026-08-09 02:26:09 on dist-test-slave-68xk"
server_key: "dca594aa564093c7a8be3bc82a2ca58e"
server_key_iv: "f07274d162056dd0af500465a7267367"
server_key_version: "encryptionkey@0"
I20260809 02:26:09.620909 1770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:09.636768 1770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:09.639911 1770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:09.640123 1770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:09.641608 1770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:09.641687 1770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:09.641767 1770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:09.641820 1770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:26:09 dist-test-slave-68xk krb5kdc[1380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242369, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
I20260809 02:26:09.653564 1770 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:44759
I20260809 02:26:09.653657 1967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:44759 every 8 connection(s)
I20260809 02:26:09.654404 1770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:26:09.656124 1523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.642653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:46463 (local address 127.21.214.190:40073)
0809 02:26:09.644094 (+ 1441us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.644100 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.644431 (+ 331us) server_negotiation.cc:407] Connection header received
0809 02:26:09.645762 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.645765 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.645826 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.645912 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:09.647431 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.647968 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.649109 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.649355 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.649485 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.652119 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:09.652123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:09.652128 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:09.652157 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:09.653730 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.654336 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.654341 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.654342 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.654474 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.654891 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.654894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.654895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.655179 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:09.655278 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:09.655896 (+ 618us) server_negotiation.cc:299] Negotiation successful
0809 02:26:09.656002 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1338}
I20260809 02:26:09.656102 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 1770
I20260809 02:26:09.656272 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:26:09.656606 22362 external_mini_cluster.cc:1428] Setting key f68fbe807c6ab9ed829411e200068fa4
I20260809 02:26:09.657137 1815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.643255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40073 (local address 127.21.214.130:46463)
0809 02:26:09.644098 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:09.644300 (+ 202us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:09.645500 (+ 1200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:09.646230 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:09.646237 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:09.646736 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:09.647283 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.647297 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.648099 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.648103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.648977 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.648986 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.649560 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.649566 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.649736 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.650364 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:09.650390 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:09.651953 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:09.653863 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:09.653869 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:09.653884 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:09.654233 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:09.654606 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:09.654609 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:09.654611 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:09.654758 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:09.655332 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:09.655338 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:09.655620 (+ 282us) client_negotiation.cc:769] Sending connection context
0809 02:26:09.655807 (+ 187us) client_negotiation.cc:240] Negotiation successful
0809 02:26:09.656165 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":170,"threads_started":1}
I20260809 02:26:09.658509 1970 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40073
I20260809 02:26:09.658654 1970 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:09.659193 1970 heartbeater.cc:511] Master 127.21.214.190:40073 requested a full tablet report, sending...
I20260809 02:26:09.660384 1445 ts_manager.cc:194] Registered new tserver with Master: b43358821f374f6a8e9526e3088afa6d (127.21.214.130:44759)
I20260809 02:26:09.661190 1445 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:46463
WARNING: no policy specified for oryx/127.21.214.131@KRBTEST.COM; defaulting to no policy
I20260809 02:26:09.668560 1982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.660835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40073 (local address 127.21.214.130:44729)
0809 02:26:09.661163 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:09.661181 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:09.661277 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:09.661585 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:09.661588 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:09.661762 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:09.661901 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.661908 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.663082 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.663085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.663791 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.663800 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.664268 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.664272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.664367 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.664885 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:09.664896 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:09.665225 (+ 329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:09.666982 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:09.666987 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:09.666989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:09.667239 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:09.667526 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:09.667530 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:09.667532 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:09.667622 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:09.668031 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:09.668034 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:09.668141 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 02:26:09.668284 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 02:26:09.668415 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":107,"threads_started":1}
I20260809 02:26:09.668563 1523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.661169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:44729 (local address 127.21.214.190:40073)
0809 02:26:09.661272 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.661276 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.661290 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:26:09.661356 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.661359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.661402 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.661481 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:09.662036 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.662794 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.663915 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.664151 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.664262 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.665359 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:09.665363 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:09.665366 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:09.665390 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:09.666868 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.667340 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.667344 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.667347 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.667431 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.667714 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.667719 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.667720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.667927 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:09.668038 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:09.668361 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 02:26:09.668455 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab.
Entry for principal oryx/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab.
I20260809 02:26:09.689164 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40073
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab
--principal=oryx/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:41497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:09.805374 1986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:09.805615 1986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:09.805660 1986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:09.809646 1986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:09.809700 1986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:09.809739 1986 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 02:26:09.809818 1986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:26:09.814983 1986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab
--principal=oryx/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.21.214.190:40073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:09.815973 1986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:09.816977 1986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:09.827306 1993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:09.827306 2004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:09.827419 2001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:09.827510 1986 server_base.cc:1034] running on GCE node
I20260809 02:26:09.828043 1986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:09.828707 1986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:09.829917 1986 hybrid_clock.cc:648] HybridClock initialized: now 1786242369829902 us; error 30 us; skew 500 ppm
Aug 09 02:26:09 dist-test-slave-68xk krb5kdc[1380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242369, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:09.832762 1986 init.cc:377] Logged in from keytab as oryx/127.21.214.131@KRBTEST.COM (short username oryx)
I20260809 02:26:09.833701 1986 webserver.cc:460] Webserver started at http://127.21.214.131:38517/ using document root <none> and password file <none>
I20260809 02:26:09.834319 1986 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:09.834424 1986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:09.834693 1986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:09.836977 1986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "c841761f04c943bc8cd4775d280ac1d6"
format_stamp: "Formatted at 2026-08-09 02:26:09 on dist-test-slave-68xk"
server_key: "3d1d72ac61077d13c028a83c5397217f"
server_key_iv: "06ccebcb2241f38f2ca50bfb1ddb9bfc"
server_key_version: "encryptionkey@0"
I20260809 02:26:09.837635 1986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "c841761f04c943bc8cd4775d280ac1d6"
format_stamp: "Formatted at 2026-08-09 02:26:09 on dist-test-slave-68xk"
server_key: "3d1d72ac61077d13c028a83c5397217f"
server_key_iv: "06ccebcb2241f38f2ca50bfb1ddb9bfc"
server_key_version: "encryptionkey@0"
I20260809 02:26:09.841727 1986 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 02:26:09.844440 2016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:09.845768 1986 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:26:09.845916 1986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "c841761f04c943bc8cd4775d280ac1d6"
format_stamp: "Formatted at 2026-08-09 02:26:09 on dist-test-slave-68xk"
server_key: "3d1d72ac61077d13c028a83c5397217f"
server_key_iv: "06ccebcb2241f38f2ca50bfb1ddb9bfc"
server_key_version: "encryptionkey@0"
I20260809 02:26:09.846038 1986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:09.861933 1986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:09.865538 1986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:09.865772 1986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:09.867527 1986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:09.867606 1986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:09.867681 1986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:09.867729 1986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 02:26:09 dist-test-slave-68xk krb5kdc[1380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242369, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
I20260809 02:26:09.880483 1986 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:34383
I20260809 02:26:09.880697 2181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:34383 every 8 connection(s)
I20260809 02:26:09.881753 1986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:26:09.883949 1523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.868406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:34823 (local address 127.21.214.190:40073)
0809 02:26:09.868594 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.868600 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.869480 (+ 880us) server_negotiation.cc:407] Connection header received
0809 02:26:09.870605 (+ 1125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.870614 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.870684 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.870801 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:09.872208 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.873212 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.874788 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.875167 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.875303 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.879491 (+ 4188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:09.879495 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:09.879499 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:09.879530 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:09.881518 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.882202 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.882210 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.882216 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.882326 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.882785 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.882791 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.882793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.883058 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:09.883176 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:09.883702 (+ 526us) server_negotiation.cc:299] Negotiation successful
0809 02:26:09.883818 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 02:26:09.884680 2031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.868791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40073 (local address 127.21.214.131:34823)
0809 02:26:09.869290 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:09.869345 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:09.870305 (+ 960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:09.871129 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:09.871138 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:09.871552 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:09.872049 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.872064 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.873414 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.873418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.874625 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.874656 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.875377 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.875381 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.875630 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.876326 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:09.876354 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:09.879300 (+ 2946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:09.881669 (+ 2369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:09.881674 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:09.881709 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:09.882055 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:09.882492 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:09.882495 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:09.882498 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:09.882664 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:09.883187 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:09.883192 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:09.883415 (+ 223us) client_negotiation.cc:769] Sending connection context
0809 02:26:09.883570 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 02:26:09.883832 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":144,"threads_started":1}
I20260809 02:26:09.886270 2182 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40073
I20260809 02:26:09.886477 2182 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:09.887159 2182 heartbeater.cc:511] Master 127.21.214.190:40073 requested a full tablet report, sending...
I20260809 02:26:09.887267 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 1986
I20260809 02:26:09.887398 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:26:09.887750 22362 external_mini_cluster.cc:1428] Setting key 173758864b2d5739ea02821679bd0b55
I20260809 02:26:09.888234 1447 ts_manager.cc:194] Registered new tserver with Master: c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383)
I20260809 02:26:09.889002 1447 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:34823
I20260809 02:26:09.889931 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:26:09.897003 2188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.888586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40073 (local address 127.21.214.131:44385)
0809 02:26:09.888898 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:09.888916 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:09.889003 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:09.889238 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:09.889241 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:09.889468 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:09.889602 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.889610 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.890738 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.890741 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.891406 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.891415 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.892038 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.892040 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.892118 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.892660 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:09.892711 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:09.893194 (+ 483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:09.895289 (+ 2095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:09.895291 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:09.895293 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:09.895493 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:09.895839 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:09.895844 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:09.895846 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:09.895944 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:09.896510 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:09.896513 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:09.896608 (+ 95us) client_negotiation.cc:769] Sending connection context
0809 02:26:09.896714 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 02:26:09.896850 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":108,"threads_started":1}
I20260809 02:26:09.897141 1523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.888912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:44385 (local address 127.21.214.190:40073)
0809 02:26:09.889009 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.889016 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.889032 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:26:09.889086 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.889088 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.889125 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.889214 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:09.889762 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.890575 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.891536 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.891915 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.892036 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.893342 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:09.893345 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:09.893347 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:09.893368 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:09.895171 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.895596 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.895602 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.895607 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.895716 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.896061 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.896067 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.896072 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.896366 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:09.896487 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:09.896819 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 02:26:09.896952 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 02:26:09 dist-test-slave-68xk krb5kdc[1380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242369, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 02:26:09 dist-test-slave-68xk krb5kdc[1380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:09 dist-test-slave-68xk krb5kdc[1380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:26:09.917555 1523 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:09.911356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49710 (local address 127.21.214.190:40073)
0809 02:26:09.911485 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.911488 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.911501 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:26:09.911544 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.911547 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.911586 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.911668 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:09.912390 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.912897 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.913719 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.913930 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.914010 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.917375 (+ 3365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49710: BlockingRecv error: recv got EOF from 127.0.0.1:49710 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 02:26:09 dist-test-slave-68xk krb5kdc[1380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242369, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
I20260809 02:26:09.926832 1523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.919068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49724 (local address 127.21.214.190:40073)
0809 02:26:09.919184 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.919188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.919322 (+ 134us) server_negotiation.cc:407] Connection header received
0809 02:26:09.919411 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.919413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.919448 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.919515 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:09.920050 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.920539 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.921267 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.921465 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.921541 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.923798 (+ 2257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:09.923801 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:09.923804 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:09.923825 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:09.925355 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.925781 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.925784 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.925785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.925859 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:09.926089 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:09.926091 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:09.926092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:09.926274 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:09.926374 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:09.926639 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 02:26:09.926724 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:26:09.929858 1445 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49724:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:26:09.932919 1445 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:26:09.947717 2218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.941848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56166 (local address 127.21.214.129:46205)
0809 02:26:09.943180 (+ 1332us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.943187 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.943212 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:26:09.943295 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.943302 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.943477 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.943635 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:09.943915 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.945135 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.946495 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.947044 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.947199 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.947349 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:09.947473 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 02:26:09.947567 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1208,"thread_start_us":96,"threads_started":1}
I20260809 02:26:09.947716 2214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.941728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:46205 (local address 127.0.0.1:56166)
0809 02:26:09.942372 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:09.942448 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:09.942587 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:09.943633 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:09.943639 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:09.943661 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:09.943788 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.943795 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.945291 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.945298 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.946281 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.946299 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.947181 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.947185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.947293 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.947330 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 02:26:09.947446 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 02:26:09.947573 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":74,"threads_started":1}
I20260809 02:26:09.948225 2220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.942570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45986 (local address 127.21.214.131:34383)
0809 02:26:09.943022 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.943037 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.943405 (+ 368us) server_negotiation.cc:407] Connection header received
0809 02:26:09.943480 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.943486 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.943643 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.943787 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:09.944120 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.944860 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.946364 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.947212 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.947346 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.947463 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:09.947976 (+ 513us) server_negotiation.cc:299] Negotiation successful
0809 02:26:09.948069 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":115,"threads_started":1}
I20260809 02:26:09.949012 2219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.941764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:44759 (local address 127.0.0.1:59714)
0809 02:26:09.943098 (+ 1334us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:09.943112 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:09.943213 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:09.943819 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:09.943822 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:09.943839 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:09.943938 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.943944 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.945322 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.945324 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.947461 (+ 2137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.947473 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.948623 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.948627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.948721 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.948751 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 02:26:09.948822 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:26:09.948888 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1275,"mutex_wait_us":977,"thread_start_us":115,"threads_started":1}
I20260809 02:26:09.949108 2221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.942570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59714 (local address 127.21.214.130:44759)
0809 02:26:09.942961 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.942975 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.943219 (+ 244us) server_negotiation.cc:407] Connection header received
0809 02:26:09.943312 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.943317 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.943510 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.943657 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:09.944068 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.945199 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.947606 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.948489 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.948647 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.948796 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:09.948850 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 02:26:09.948940 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":125,"threads_started":1}
I20260809 02:26:09.949481 2217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.942039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:34383 (local address 127.0.0.1:45986)
0809 02:26:09.943190 (+ 1151us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:09.943207 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:09.943307 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:09.943924 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:09.943927 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:09.943940 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:09.944026 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.944033 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.944979 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.944984 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.946241 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.946250 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.947528 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.947534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.947634 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.947657 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:26:09.947726 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 02:26:09.948382 (+ 656us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1068,"mutex_wait_us":1,"thread_start_us":82,"threads_started":1}
I20260809 02:26:09.951236 1657 tablet_service.cc:1467] Processing CreateTablet for tablet e4ea448398c64506bb6aa71f77a03a72 (DEFAULT_TABLE table=test-table [id=c4b92b06233c4b02baa841bba0077e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:09.951920 1875 tablet_service.cc:1467] Processing CreateTablet for tablet e4ea448398c64506bb6aa71f77a03a72 (DEFAULT_TABLE table=test-table [id=c4b92b06233c4b02baa841bba0077e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:09.952050 2086 tablet_service.cc:1467] Processing CreateTablet for tablet e4ea448398c64506bb6aa71f77a03a72 (DEFAULT_TABLE table=test-table [id=c4b92b06233c4b02baa841bba0077e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:09.952708 1657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4ea448398c64506bb6aa71f77a03a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:09.952911 1875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4ea448398c64506bb6aa71f77a03a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:09.953043 2086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4ea448398c64506bb6aa71f77a03a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:09.960204 2222 tablet_bootstrap.cc:492] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6: Bootstrap starting.
I20260809 02:26:09.961228 2225 tablet_bootstrap.cc:492] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d: Bootstrap starting.
I20260809 02:26:09.962281 2222 tablet_bootstrap.cc:654] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:09.962741 2223 tablet_bootstrap.cc:492] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17: Bootstrap starting.
I20260809 02:26:09.963117 2222 log.cc:824] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:09.963172 2225 tablet_bootstrap.cc:654] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:09.964030 2225 log.cc:824] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:09.964859 2223 tablet_bootstrap.cc:654] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:09.965230 2222 tablet_bootstrap.cc:492] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6: No bootstrap required, opened a new log
I20260809 02:26:09.965430 2222 ts_tablet_manager.cc:1397] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:26:09.965695 2223 log.cc:824] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:09.966244 2225 tablet_bootstrap.cc:492] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d: No bootstrap required, opened a new log
I20260809 02:26:09.966471 2225 ts_tablet_manager.cc:1397] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:26:09.967599 2223 tablet_bootstrap.cc:492] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17: No bootstrap required, opened a new log
I20260809 02:26:09.967798 2223 ts_tablet_manager.cc:1397] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 02:26:09.968811 2222 raft_consensus.cc:348] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:09.969049 2222 raft_consensus.cc:374] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:09.969102 2222 raft_consensus.cc:729] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c841761f04c943bc8cd4775d280ac1d6, State: Initialized, Role: FOLLOWER
I20260809 02:26:09.969554 2222 consensus_queue.cc:260] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:09.970201 2182 heartbeater.cc:503] Master 127.21.214.190:40073 was elected leader, sending a full tablet report...
I20260809 02:26:09.970654 2222 ts_tablet_manager.cc:1428] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260809 02:26:09.970544 2225 raft_consensus.cc:348] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:09.970779 2225 raft_consensus.cc:374] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:09.970830 2225 raft_consensus.cc:729] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43358821f374f6a8e9526e3088afa6d, State: Initialized, Role: FOLLOWER
I20260809 02:26:09.971248 2225 consensus_queue.cc:260] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:09.971916 1970 heartbeater.cc:503] Master 127.21.214.190:40073 was elected leader, sending a full tablet report...
I20260809 02:26:09.972009 2223 raft_consensus.cc:348] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:09.972235 2223 raft_consensus.cc:374] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:09.972306 2223 raft_consensus.cc:729] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea99a65250d8470fb8fcee259b37ee17, State: Initialized, Role: FOLLOWER
I20260809 02:26:09.972739 2223 consensus_queue.cc:260] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:09.973099 2225 ts_tablet_manager.cc:1428] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260809 02:26:09.973533 2223 ts_tablet_manager.cc:1428] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 02:26:09.973898 1759 heartbeater.cc:503] Master 127.21.214.190:40073 was elected leader, sending a full tablet report...
I20260809 02:26:09.984449 2244 raft_consensus.cc:482] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:26:09.984648 2244 raft_consensus.cc:504] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:09.985702 2244 leader_election.cc:288] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea99a65250d8470fb8fcee259b37ee17 (127.21.214.129:46205), c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383)
I20260809 02:26:09.989897 1815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.985893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:46205 (local address 127.21.214.130:58621)
0809 02:26:09.986034 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:09.986050 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:09.986157 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:09.986454 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:09.986461 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:09.986478 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:09.986627 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.986635 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.987710 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.987714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.988574 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.988583 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.989522 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.989525 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.989605 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.989624 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 02:26:09.989695 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:26:09.989749 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 02:26:09.989964 2218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.986070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:58621 (local address 127.21.214.129:46205)
0809 02:26:09.986200 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.986204 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.986219 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:26:09.986269 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.986274 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.986323 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.986445 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:09.986837 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.987595 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.988717 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.989397 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.989522 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.989575 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:09.989723 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 02:26:09.989817 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:26:09.990603 1680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4ea448398c64506bb6aa71f77a03a72" candidate_uuid: "b43358821f374f6a8e9526e3088afa6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea99a65250d8470fb8fcee259b37ee17" is_pre_election: true
I20260809 02:26:09.990942 1680 raft_consensus.cc:2454] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b43358821f374f6a8e9526e3088afa6d in term 0.
I20260809 02:26:09.991124 2220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.986080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:40117 (local address 127.21.214.131:34383)
0809 02:26:09.986256 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:09.986260 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:09.986552 (+ 292us) server_negotiation.cc:407] Connection header received
0809 02:26:09.986663 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:09.986669 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:09.986726 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:09.986806 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:09.987152 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.987855 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.989864 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.990503 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.990647 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.990699 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:09.990928 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 02:26:09.991007 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260809 02:26:09.991149 2247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:09.985976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:34383 (local address 127.21.214.130:40117)
0809 02:26:09.986458 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:09.986472 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:09.986568 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:09.986850 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:09.986853 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:09.986883 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:09.987021 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.987029 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.987970 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.987973 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.989730 (+ 1757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:09.989742 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:09.990667 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:09.990671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:09.990785 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:09.990812 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 02:26:09.990904 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 02:26:09.990994 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":123,"threads_started":1}
I20260809 02:26:09.991508 1803 leader_election.cc:302] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43358821f374f6a8e9526e3088afa6d, ea99a65250d8470fb8fcee259b37ee17; no voters:
I20260809 02:26:09.991842 2244 raft_consensus.cc:2781] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:26:09.991955 2244 raft_consensus.cc:482] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:26:09.992024 2244 raft_consensus.cc:3037] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:09.991957 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4ea448398c64506bb6aa71f77a03a72" candidate_uuid: "b43358821f374f6a8e9526e3088afa6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c841761f04c943bc8cd4775d280ac1d6" is_pre_election: true
I20260809 02:26:09.992251 2112 raft_consensus.cc:2454] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b43358821f374f6a8e9526e3088afa6d in term 0.
I20260809 02:26:09.993431 2244 raft_consensus.cc:504] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:09.993778 2244 leader_election.cc:288] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [CANDIDATE]: Term 1 election: Requested vote from peers ea99a65250d8470fb8fcee259b37ee17 (127.21.214.129:46205), c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383)
I20260809 02:26:09.994061 1680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4ea448398c64506bb6aa71f77a03a72" candidate_uuid: "b43358821f374f6a8e9526e3088afa6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea99a65250d8470fb8fcee259b37ee17"
I20260809 02:26:09.994134 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4ea448398c64506bb6aa71f77a03a72" candidate_uuid: "b43358821f374f6a8e9526e3088afa6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c841761f04c943bc8cd4775d280ac1d6"
I20260809 02:26:09.994195 1680 raft_consensus.cc:3037] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:09.994290 2112 raft_consensus.cc:3037] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:09.995313 1680 raft_consensus.cc:2454] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b43358821f374f6a8e9526e3088afa6d in term 1.
I20260809 02:26:09.995460 2112 raft_consensus.cc:2454] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b43358821f374f6a8e9526e3088afa6d in term 1.
I20260809 02:26:09.995604 1803 leader_election.cc:302] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43358821f374f6a8e9526e3088afa6d, ea99a65250d8470fb8fcee259b37ee17; no voters:
I20260809 02:26:09.995801 2244 raft_consensus.cc:2781] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:09.996025 2244 raft_consensus.cc:686] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [term 1 LEADER]: Becoming Leader. State: Replica: b43358821f374f6a8e9526e3088afa6d, State: Running, Role: LEADER
I20260809 02:26:09.996353 2244 consensus_queue.cc:237] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:09.999387 1444 catalog_manager.cc:5495] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d reported cstate change: term changed from 0 to 1, leader changed from <none> to b43358821f374f6a8e9526e3088afa6d (127.21.214.130). New cstate: current_term: 1 leader_uuid: "b43358821f374f6a8e9526e3088afa6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } health_report { overall_health: UNKNOWN } } }
I20260809 02:26:10.011581 2221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.008224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59728 (local address 127.21.214.130:44759)
0809 02:26:10.008369 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:10.008372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:10.008387 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:26:10.008514 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:10.008516 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:10.008569 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:10.008661 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:26:10.008871 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.009376 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.010226 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.010524 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.010606 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.010853 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:26:10.011279 (+ 426us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:26:10.011370 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:10.011432 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 02:26:10.011479 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 02:26:10.017189 1680 raft_consensus.cc:1261] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Refusing update from remote peer b43358821f374f6a8e9526e3088afa6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:10.017187 2112 raft_consensus.cc:1261] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Refusing update from remote peer b43358821f374f6a8e9526e3088afa6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:10.017905 2244 consensus_queue.cc:1035] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:10.018123 2248 consensus_queue.cc:1035] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:10.026532 2254 mvcc.cc:205] Tried to move back new op lower bound from 7316448747583574016 to 7316448747507478528. Current Snapshot: MvccSnapshot[applied={T|T < 7316448747583574016}]
I20260809 02:26:10.032967 1447 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:10.033134 1447 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:10.035422 1447 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e: Sending DeleteTablet for 3 replicas of tablet e4ea448398c64506bb6aa71f77a03a72
I20260809 02:26:10.036140 1657 tablet_service.cc:1514] Processing DeleteTablet for tablet e4ea448398c64506bb6aa71f77a03a72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:10 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:56166
I20260809 02:26:10.036180 1875 tablet_service.cc:1514] Processing DeleteTablet for tablet e4ea448398c64506bb6aa71f77a03a72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:10 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:59714
I20260809 02:26:10.036337 2086 tablet_service.cc:1514] Processing DeleteTablet for tablet e4ea448398c64506bb6aa71f77a03a72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:10 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:45986
I20260809 02:26:10.036779 2267 tablet_replica.cc:330] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6: stopping tablet replica
I20260809 02:26:10.036947 2264 tablet_replica.cc:330] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17: stopping tablet replica
I20260809 02:26:10.037168 2267 raft_consensus.cc:2229] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:10.037285 2264 raft_consensus.cc:2229] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:10.037523 2267 raft_consensus.cc:2258] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:10.037575 2264 raft_consensus.cc:2258] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:10.037572 1447 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49724:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:26:10.038025 1447 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:26:10.038151 2266 tablet_replica.cc:330] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d: stopping tablet replica
I20260809 02:26:10.038486 2266 raft_consensus.cc:2229] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:26:10.038834 2266 raft_consensus.cc:2258] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:10.040023 2264 ts_tablet_manager.cc:1905] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:10.041072 2267 ts_tablet_manager.cc:1905] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:10.042999 2264 ts_tablet_manager.cc:1918] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:26:10.043099 2264 log.cc:1196] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/wal/wals/e4ea448398c64506bb6aa71f77a03a72
I20260809 02:26:10.043741 1657 tablet_service.cc:1467] Processing CreateTablet for tablet 27bf033e965346dbaa65689a1924c316 (DEFAULT_TABLE table=test-table [id=125bf412869b43c8b761b0808320d6bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:10.043741 2086 tablet_service.cc:1467] Processing CreateTablet for tablet 27bf033e965346dbaa65689a1924c316 (DEFAULT_TABLE table=test-table [id=125bf412869b43c8b761b0808320d6bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:10.043895 2267 ts_tablet_manager.cc:1918] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:26:10.043983 1657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27bf033e965346dbaa65689a1924c316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:10.043983 2086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27bf033e965346dbaa65689a1924c316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:10.043989 2267 log.cc:1196] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/e4ea448398c64506bb6aa71f77a03a72
I20260809 02:26:10.044377 2267 ts_tablet_manager.cc:1939] T e4ea448398c64506bb6aa71f77a03a72 P c841761f04c943bc8cd4775d280ac1d6: Deleting consensus metadata
I20260809 02:26:10.045608 1427 catalog_manager.cc:4841] TS c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383): tablet e4ea448398c64506bb6aa71f77a03a72 (table test-table [id=c4b92b06233c4b02baa841bba0077e93]) successfully deleted
I20260809 02:26:10.046166 2222 tablet_bootstrap.cc:492] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6: Bootstrap starting.
I20260809 02:26:10.047091 1875 tablet_service.cc:1467] Processing CreateTablet for tablet 27bf033e965346dbaa65689a1924c316 (DEFAULT_TABLE table=test-table [id=125bf412869b43c8b761b0808320d6bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:10.047149 2222 tablet_bootstrap.cc:654] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:10.047360 1875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27bf033e965346dbaa65689a1924c316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:10.047605 2266 ts_tablet_manager.cc:1905] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:10.047758 2223 tablet_bootstrap.cc:492] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17: Bootstrap starting.
I20260809 02:26:10.048692 2223 tablet_bootstrap.cc:654] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:10.049355 2264 ts_tablet_manager.cc:1939] T e4ea448398c64506bb6aa71f77a03a72 P ea99a65250d8470fb8fcee259b37ee17: Deleting consensus metadata
I20260809 02:26:10.049887 2225 tablet_bootstrap.cc:492] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d: Bootstrap starting.
I20260809 02:26:10.050839 2225 tablet_bootstrap.cc:654] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:10.051472 2266 ts_tablet_manager.cc:1918] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:26:10.051579 2266 log.cc:1196] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/e4ea448398c64506bb6aa71f77a03a72
I20260809 02:26:10.051862 2222 tablet_bootstrap.cc:492] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6: No bootstrap required, opened a new log
I20260809 02:26:10.051904 2266 ts_tablet_manager.cc:1939] T e4ea448398c64506bb6aa71f77a03a72 P b43358821f374f6a8e9526e3088afa6d: Deleting consensus metadata
I20260809 02:26:10.051947 2222 ts_tablet_manager.cc:1397] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260809 02:26:10.052192 2225 tablet_bootstrap.cc:492] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d: No bootstrap required, opened a new log
I20260809 02:26:10.052265 2225 ts_tablet_manager.cc:1397] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:26:10.052404 2222 raft_consensus.cc:348] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.052507 2222 raft_consensus.cc:374] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:10.052537 2222 raft_consensus.cc:729] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c841761f04c943bc8cd4775d280ac1d6, State: Initialized, Role: FOLLOWER
I20260809 02:26:10.052654 2222 consensus_queue.cc:260] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.052665 2225 raft_consensus.cc:348] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.052784 2225 raft_consensus.cc:374] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:10.052825 2225 raft_consensus.cc:729] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43358821f374f6a8e9526e3088afa6d, State: Initialized, Role: FOLLOWER
I20260809 02:26:10.052891 2222 ts_tablet_manager.cc:1428] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:26:10.052940 1424 catalog_manager.cc:4841] TS b43358821f374f6a8e9526e3088afa6d (127.21.214.130:44759): tablet e4ea448398c64506bb6aa71f77a03a72 (table test-table [id=c4b92b06233c4b02baa841bba0077e93]) successfully deleted
I20260809 02:26:10.052940 2225 consensus_queue.cc:260] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.053217 2225 ts_tablet_manager.cc:1428] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:26:10.053282 1425 catalog_manager.cc:4841] TS ea99a65250d8470fb8fcee259b37ee17 (127.21.214.129:46205): tablet e4ea448398c64506bb6aa71f77a03a72 (table test-table [id=c4b92b06233c4b02baa841bba0077e93]) successfully deleted
I20260809 02:26:10.054538 2223 tablet_bootstrap.cc:492] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17: No bootstrap required, opened a new log
I20260809 02:26:10.054622 2223 ts_tablet_manager.cc:1397] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260809 02:26:10.055173 2223 raft_consensus.cc:348] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.055297 2223 raft_consensus.cc:374] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:10.055334 2223 raft_consensus.cc:729] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea99a65250d8470fb8fcee259b37ee17, State: Initialized, Role: FOLLOWER
I20260809 02:26:10.055449 2223 consensus_queue.cc:260] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.056208 2223 ts_tablet_manager.cc:1428] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260809 02:26:10.132827 2183 tablet.cc:2369] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:26:10.155836 1972 tablet.cc:2369] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:26:10.181941 1761 tablet.cc:2369] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:26:10.413757 2245 raft_consensus.cc:482] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:26:10.413926 2245 raft_consensus.cc:504] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.415195 2245 leader_election.cc:288] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b43358821f374f6a8e9526e3088afa6d (127.21.214.130:44759), c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383)
I20260809 02:26:10.420179 2272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.415485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:44759 (local address 127.21.214.129:55413)
0809 02:26:10.415923 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:10.415942 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:10.416126 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:10.416478 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:10.416483 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:10.416506 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:10.416666 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:10.416672 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.417610 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.417614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:10.418862 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:10.418873 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.419677 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.419681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:10.419825 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.419853 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 02:26:10.419939 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 02:26:10.419997 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":107,"threads_started":1}
I20260809 02:26:10.420217 2221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.415753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:55413 (local address 127.21.214.130:44759)
0809 02:26:10.415897 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:10.415902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:10.416046 (+ 144us) server_negotiation.cc:407] Connection header received
0809 02:26:10.416276 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:10.416279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:10.416348 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:10.416436 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:10.416793 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.417485 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.418995 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.419511 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.419617 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.419674 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:10.419970 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 02:26:10.420074 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:26:10.420324 2220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.415654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:53985 (local address 127.21.214.131:34383)
0809 02:26:10.415821 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:10.415828 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:10.416279 (+ 451us) server_negotiation.cc:407] Connection header received
0809 02:26:10.416500 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:10.416503 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:10.416562 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:10.416621 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:10.417110 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.417841 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.419186 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.419696 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.419832 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.419882 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:10.420100 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 02:26:10.420181 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 02:26:10.420382 2273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.415485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:34383 (local address 127.21.214.129:53985)
0809 02:26:10.416156 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:10.416169 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:10.416360 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:10.416771 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:10.416775 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:10.416794 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:10.416927 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:10.416934 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.417963 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.417966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:10.419038 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:10.419050 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.419833 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.419836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:10.419951 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.419980 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 02:26:10.420065 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 02:26:10.420135 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"mutex_wait_us":156,"thread_start_us":109,"threads_started":1}
I20260809 02:26:10.420881 1904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27bf033e965346dbaa65689a1924c316" candidate_uuid: "ea99a65250d8470fb8fcee259b37ee17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b43358821f374f6a8e9526e3088afa6d" is_pre_election: true
I20260809 02:26:10.420917 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27bf033e965346dbaa65689a1924c316" candidate_uuid: "ea99a65250d8470fb8fcee259b37ee17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c841761f04c943bc8cd4775d280ac1d6" is_pre_election: true
I20260809 02:26:10.421114 2112 raft_consensus.cc:2454] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea99a65250d8470fb8fcee259b37ee17 in term 0.
I20260809 02:26:10.421166 1904 raft_consensus.cc:2454] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea99a65250d8470fb8fcee259b37ee17 in term 0.
I20260809 02:26:10.421554 1587 leader_election.cc:302] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c841761f04c943bc8cd4775d280ac1d6, ea99a65250d8470fb8fcee259b37ee17; no voters:
I20260809 02:26:10.421872 2245 raft_consensus.cc:2781] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:26:10.421942 2245 raft_consensus.cc:482] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:26:10.421984 2245 raft_consensus.cc:3037] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:10.423126 2245 raft_consensus.cc:504] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.423480 2245 leader_election.cc:288] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [CANDIDATE]: Term 1 election: Requested vote from peers b43358821f374f6a8e9526e3088afa6d (127.21.214.130:44759), c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383)
I20260809 02:26:10.423854 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27bf033e965346dbaa65689a1924c316" candidate_uuid: "ea99a65250d8470fb8fcee259b37ee17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c841761f04c943bc8cd4775d280ac1d6"
I20260809 02:26:10.423854 1904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27bf033e965346dbaa65689a1924c316" candidate_uuid: "ea99a65250d8470fb8fcee259b37ee17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b43358821f374f6a8e9526e3088afa6d"
I20260809 02:26:10.423995 1904 raft_consensus.cc:3037] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:10.423979 2112 raft_consensus.cc:3037] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:10.425385 2112 raft_consensus.cc:2454] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea99a65250d8470fb8fcee259b37ee17 in term 1.
I20260809 02:26:10.425385 1904 raft_consensus.cc:2454] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea99a65250d8470fb8fcee259b37ee17 in term 1.
I20260809 02:26:10.425746 1587 leader_election.cc:302] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c841761f04c943bc8cd4775d280ac1d6, ea99a65250d8470fb8fcee259b37ee17; no voters:
I20260809 02:26:10.425989 2245 raft_consensus.cc:2781] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:10.426241 2245 raft_consensus.cc:686] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [term 1 LEADER]: Becoming Leader. State: Replica: ea99a65250d8470fb8fcee259b37ee17, State: Running, Role: LEADER
I20260809 02:26:10.426554 2245 consensus_queue.cc:237] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.429237 1447 catalog_manager.cc:5495] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea99a65250d8470fb8fcee259b37ee17 (127.21.214.129). New cstate: current_term: 1 leader_uuid: "ea99a65250d8470fb8fcee259b37ee17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } health_report { overall_health: UNKNOWN } } }
Aug 09 02:26:10 dist-test-slave-68xk krb5kdc[1380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242369, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.190@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
I20260809 02:26:10.545617 2284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.536405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40073 (local address 127.0.0.1:49732)
0809 02:26:10.536772 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:10.536788 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:10.536901 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:10.537264 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:10.537266 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:10.537718 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:10.537827 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:10.537834 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.538736 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.538739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:10.539402 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:10.539412 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.539891 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.539894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:10.539965 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.540669 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:10.540683 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:10.542247 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:10.544110 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:10.544119 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:10.544125 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:10.544384 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:10.544649 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:10.544651 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:10.544652 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:10.544738 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:10.545089 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:10.545094 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:10.545211 (+ 117us) client_negotiation.cc:769] Sending connection context
0809 02:26:10.545313 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 02:26:10.545431 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":117,"threads_started":1}
I20260809 02:26:10.545624 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.536444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49732 (local address 127.21.214.190:40073)
0809 02:26:10.536869 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:10.536879 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:10.536897 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:26:10.536999 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:10.537002 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:10.537113 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:10.537220 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:10.537971 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.538599 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.539526 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.539772 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.539858 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.542379 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:10.542382 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:10.542384 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:10.542406 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:10.543981 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:10.544480 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:10.544482 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:10.544483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:10.544562 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:10.544820 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:10.544822 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:10.544823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:10.544984 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:10.545072 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:10.545384 (+ 312us) server_negotiation.cc:299] Negotiation successful
0809 02:26:10.545485 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":176,"threads_started":1}
I20260809 02:26:10.549852 1447 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:49732:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 02:26:10.550681 1447 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:26:10.555962 1657 tablet_service.cc:1467] Processing CreateTablet for tablet e5839b7d84fa437680105d6459fc9759 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=cd6e71de562e4817a3aa8d595f4adaf6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:26:10.556097 1875 tablet_service.cc:1467] Processing CreateTablet for tablet e5839b7d84fa437680105d6459fc9759 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=cd6e71de562e4817a3aa8d595f4adaf6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:26:10.556437 1657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5839b7d84fa437680105d6459fc9759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:10.556479 1875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5839b7d84fa437680105d6459fc9759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:10.556317 2086 tablet_service.cc:1467] Processing CreateTablet for tablet e5839b7d84fa437680105d6459fc9759 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=cd6e71de562e4817a3aa8d595f4adaf6]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 02:26:10.556965 2086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5839b7d84fa437680105d6459fc9759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:10.559654 2286 tablet_bootstrap.cc:492] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d: Bootstrap starting.
I20260809 02:26:10.559680 2287 tablet_bootstrap.cc:492] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17: Bootstrap starting.
I20260809 02:26:10.560331 2288 tablet_bootstrap.cc:492] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6: Bootstrap starting.
I20260809 02:26:10.560593 2287 tablet_bootstrap.cc:654] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:10.560987 2286 tablet_bootstrap.cc:654] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:10.561331 2288 tablet_bootstrap.cc:654] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:10.562042 2287 tablet_bootstrap.cc:492] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17: No bootstrap required, opened a new log
I20260809 02:26:10.562119 2287 ts_tablet_manager.cc:1397] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:26:10.562661 2287 raft_consensus.cc:348] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.562757 2288 tablet_bootstrap.cc:492] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6: No bootstrap required, opened a new log
I20260809 02:26:10.562798 2287 raft_consensus.cc:374] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:10.562835 2288 ts_tablet_manager.cc:1397] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:26:10.562834 2287 raft_consensus.cc:729] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea99a65250d8470fb8fcee259b37ee17, State: Initialized, Role: FOLLOWER
I20260809 02:26:10.562992 2287 consensus_queue.cc:260] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.563234 2245 tablet_replica.cc:439] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } } }
I20260809 02:26:10.563287 2288 raft_consensus.cc:348] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.563374 2245 tablet_replica.cc:442] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:26:10.563385 2288 raft_consensus.cc:374] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:10.563419 2288 raft_consensus.cc:729] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c841761f04c943bc8cd4775d280ac1d6, State: Initialized, Role: FOLLOWER
I20260809 02:26:10.563623 2287 ts_tablet_manager.cc:1428] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 02:26:10.563571 2288 consensus_queue.cc:260] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.563927 2288 ts_tablet_manager.cc:1428] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:26:10.563959 2292 tablet_replica.cc:439] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } } }
I20260809 02:26:10.564133 2292 tablet_replica.cc:442] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:26:10.564402 2286 tablet_bootstrap.cc:492] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d: No bootstrap required, opened a new log
I20260809 02:26:10.564491 2286 ts_tablet_manager.cc:1397] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 02:26:10.564872 2286 raft_consensus.cc:348] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.564956 2286 raft_consensus.cc:374] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:10.564977 2286 raft_consensus.cc:729] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43358821f374f6a8e9526e3088afa6d, State: Initialized, Role: FOLLOWER
I20260809 02:26:10.565104 2286 consensus_queue.cc:260] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.565438 2286 ts_tablet_manager.cc:1428] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:26:10.566042 2294 tablet_replica.cc:439] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } } }
I20260809 02:26:10.566215 2294 tablet_replica.cc:442] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:26:10.581385 2294 raft_consensus.cc:482] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:26:10.581526 2294 raft_consensus.cc:504] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.581924 2294 leader_election.cc:288] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea99a65250d8470fb8fcee259b37ee17 (127.21.214.129:46205), c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383)
I20260809 02:26:10.582334 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5839b7d84fa437680105d6459fc9759" candidate_uuid: "b43358821f374f6a8e9526e3088afa6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c841761f04c943bc8cd4775d280ac1d6" is_pre_election: true
I20260809 02:26:10.582384 1680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5839b7d84fa437680105d6459fc9759" candidate_uuid: "b43358821f374f6a8e9526e3088afa6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea99a65250d8470fb8fcee259b37ee17" is_pre_election: true
I20260809 02:26:10.582549 2112 raft_consensus.cc:2454] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b43358821f374f6a8e9526e3088afa6d in term 0.
I20260809 02:26:10.582576 1680 raft_consensus.cc:2454] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b43358821f374f6a8e9526e3088afa6d in term 0.
I20260809 02:26:10.582872 1807 leader_election.cc:302] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43358821f374f6a8e9526e3088afa6d, c841761f04c943bc8cd4775d280ac1d6; no voters:
I20260809 02:26:10.583096 2294 raft_consensus.cc:2781] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:26:10.583158 2294 raft_consensus.cc:482] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:26:10.583186 2294 raft_consensus.cc:3037] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:10.584206 2294 raft_consensus.cc:504] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.584570 2294 leader_election.cc:288] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [CANDIDATE]: Term 1 election: Requested vote from peers ea99a65250d8470fb8fcee259b37ee17 (127.21.214.129:46205), c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383)
I20260809 02:26:10.584921 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5839b7d84fa437680105d6459fc9759" candidate_uuid: "b43358821f374f6a8e9526e3088afa6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c841761f04c943bc8cd4775d280ac1d6"
I20260809 02:26:10.584975 1680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5839b7d84fa437680105d6459fc9759" candidate_uuid: "b43358821f374f6a8e9526e3088afa6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea99a65250d8470fb8fcee259b37ee17"
I20260809 02:26:10.585069 2112 raft_consensus.cc:3037] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:10.585108 1680 raft_consensus.cc:3037] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:10.586038 2112 raft_consensus.cc:2454] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b43358821f374f6a8e9526e3088afa6d in term 1.
I20260809 02:26:10.586170 1680 raft_consensus.cc:2454] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b43358821f374f6a8e9526e3088afa6d in term 1.
I20260809 02:26:10.586385 1807 leader_election.cc:302] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43358821f374f6a8e9526e3088afa6d, c841761f04c943bc8cd4775d280ac1d6; no voters:
I20260809 02:26:10.586568 2294 raft_consensus.cc:2781] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:10.586773 2294 raft_consensus.cc:686] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [term 1 LEADER]: Becoming Leader. State: Replica: b43358821f374f6a8e9526e3088afa6d, State: Running, Role: LEADER
I20260809 02:26:10.586933 2294 consensus_queue.cc:237] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.587666 2296 tablet_replica.cc:439] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d: TxnStatusTablet state changed. Reason: New leader b43358821f374f6a8e9526e3088afa6d. Latest consensus state: current_term: 1 leader_uuid: "b43358821f374f6a8e9526e3088afa6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } } }
I20260809 02:26:10.587771 2296 tablet_replica.cc:442] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:26:10.588043 2298 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 02:26:10.588225 2298 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 02:26:10.588675 1444 catalog_manager.cc:5495] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d reported cstate change: term changed from 0 to 1, leader changed from <none> to b43358821f374f6a8e9526e3088afa6d (127.21.214.130). New cstate: current_term: 1 leader_uuid: "b43358821f374f6a8e9526e3088afa6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } health_report { overall_health: UNKNOWN } } }
I20260809 02:26:10.603009 2284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.599493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:44759 (local address 127.0.0.1:59736)
0809 02:26:10.599667 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:10.599683 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:10.599860 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:10.600148 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:10.600151 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:10.600158 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:26:10.600268 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:10.600274 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.601003 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.601007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:10.601726 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:10.601740 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.602208 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.602212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:10.602304 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.602356 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:26:10.602723 (+ 367us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:26:10.602741 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 02:26:10.602806 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:26:10.602895 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 02:26:10.603009 2221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.599585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59736 (local address 127.21.214.130:44759)
0809 02:26:10.599703 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:10.599708 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:10.599786 (+ 78us) server_negotiation.cc:407] Connection header received
0809 02:26:10.599980 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:10.599985 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:10.600036 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:10.600115 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:26:10.600379 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.600886 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.601866 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.602093 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.602215 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.602552 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:26:10.602626 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:26:10.602710 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:10.602817 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 02:26:10.602872 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:26:10.606173 1680 raft_consensus.cc:1261] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Refusing update from remote peer b43358821f374f6a8e9526e3088afa6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:10.606282 2112 raft_consensus.cc:1261] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Refusing update from remote peer b43358821f374f6a8e9526e3088afa6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:10.606688 2294 consensus_queue.cc:1035] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:10.606885 2296 consensus_queue.cc:1035] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:10.608228 2245 tablet_replica.cc:439] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17: TxnStatusTablet state changed. Reason: New leader b43358821f374f6a8e9526e3088afa6d. Latest consensus state: current_term: 1 leader_uuid: "b43358821f374f6a8e9526e3088afa6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } } }
I20260809 02:26:10.608345 2245 tablet_replica.cc:442] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:26:10.609982 2292 tablet_replica.cc:439] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6: TxnStatusTablet state changed. Reason: New leader b43358821f374f6a8e9526e3088afa6d. Latest consensus state: current_term: 1 leader_uuid: "b43358821f374f6a8e9526e3088afa6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } } }
I20260809 02:26:10.610106 2292 tablet_replica.cc:442] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:26:10.611207 2294 tablet_replica.cc:439] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b43358821f374f6a8e9526e3088afa6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } } }
I20260809 02:26:10.611316 2294 tablet_replica.cc:442] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:26:10.611410 2303 mvcc.cc:205] Tried to move back new op lower bound from 7316448749997928448 to 7316448749925584896. Current Snapshot: MvccSnapshot[applied={T|T < 7316448749997928448}]
I20260809 02:26:10.612573 2245 tablet_replica.cc:439] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b43358821f374f6a8e9526e3088afa6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } } }
I20260809 02:26:10.612689 2245 tablet_replica.cc:442] T e5839b7d84fa437680105d6459fc9759 P ea99a65250d8470fb8fcee259b37ee17: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:26:10.614704 2296 tablet_replica.cc:439] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b43358821f374f6a8e9526e3088afa6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } } }
I20260809 02:26:10.614820 2296 tablet_replica.cc:442] T e5839b7d84fa437680105d6459fc9759 P b43358821f374f6a8e9526e3088afa6d: This TxnStatusTablet replica's current role is: LEADER
I20260809 02:26:10.615702 2304 mvcc.cc:205] Tried to move back new op lower bound from 7316448749997928448 to 7316448749925584896. Current Snapshot: MvccSnapshot[applied={T|T < 7316448749997928448 or (T in {7316448749997928448})}]
I20260809 02:26:10.616024 2292 tablet_replica.cc:439] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b43358821f374f6a8e9526e3088afa6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } } }
I20260809 02:26:10.616135 2292 tablet_replica.cc:442] T e5839b7d84fa437680105d6459fc9759 P c841761f04c943bc8cd4775d280ac1d6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 02:26:10.623598 2317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.619097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56170 (local address 127.21.214.129:46205)
0809 02:26:10.619361 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:10.619371 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:10.619387 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:26:10.619542 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:10.619545 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:10.619617 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:10.619741 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:26:10.619967 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.620803 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.622032 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.622270 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.622347 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.622696 (+ 349us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:26:10.623187 (+ 491us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:26:10.623294 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:10.623399 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 02:26:10.623454 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":120,"threads_started":1}
I20260809 02:26:10.634806 2221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.631049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:44795 (local address 127.21.214.130:44759)
0809 02:26:10.631192 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:10.631197 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:10.631369 (+ 172us) server_negotiation.cc:407] Connection header received
0809 02:26:10.631493 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:10.631495 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:10.631538 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:10.631601 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:26:10.631894 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.632364 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.633545 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.633798 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.633906 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.634233 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:26:10.634318 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:26:10.634397 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:10.634542 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 02:26:10.634610 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 02:26:10.634964 2320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.630990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:44759 (local address 127.21.214.129:44795)
0809 02:26:10.631280 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:10.631296 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:10.631401 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:10.631637 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:10.631640 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:10.631648 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:26:10.631792 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:10.631797 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.632466 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.632469 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:10.633417 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:10.633428 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.633922 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.633926 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:10.634027 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.634079 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:26:10.634446 (+ 367us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:26:10.634454 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 02:26:10.634515 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 02:26:10.634803 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":107,"threads_started":1}
I20260809 02:26:10.642174 2112 raft_consensus.cc:1261] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Refusing update from remote peer ea99a65250d8470fb8fcee259b37ee17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:10.642669 1904 raft_consensus.cc:1261] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Refusing update from remote peer ea99a65250d8470fb8fcee259b37ee17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:10.642793 2274 consensus_queue.cc:1035] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:10.643162 2245 consensus_queue.cc:1035] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:10.679663 2330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.675368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:46205 (local address 127.21.214.130:56557)
0809 02:26:10.675822 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:10.675839 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:10.676017 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:10.676486 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:10.676489 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:10.676498 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 02:26:10.676626 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:10.676631 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.677513 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.677517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:10.678214 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:10.678223 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.678820 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.678824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:10.678933 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.678982 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 02:26:10.679319 (+ 337us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 02:26:10.679329 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 02:26:10.679401 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 02:26:10.679494 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":129,"threads_started":1}
I20260809 02:26:10.680415 2317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.675499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:56557 (local address 127.21.214.129:46205)
0809 02:26:10.675663 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:10.675671 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:10.675920 (+ 249us) server_negotiation.cc:407] Connection header received
0809 02:26:10.676172 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:10.676176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:10.676247 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:10.676308 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:26:10.676758 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.677376 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.678369 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.678699 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.678822 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.679141 (+ 319us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:26:10.679225 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:26:10.679313 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:10.679412 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 02:26:10.679470 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:26:10.712567 1447 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:10.712781 1447 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:10.715516 1447 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e: Sending DeleteTablet for 3 replicas of tablet 27bf033e965346dbaa65689a1924c316
I20260809 02:26:10.716140 1657 tablet_service.cc:1514] Processing DeleteTablet for tablet 27bf033e965346dbaa65689a1924c316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:10 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:56166
I20260809 02:26:10.716390 2086 tablet_service.cc:1514] Processing DeleteTablet for tablet 27bf033e965346dbaa65689a1924c316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:10 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:45986
I20260809 02:26:10.716877 2334 tablet_replica.cc:330] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6: stopping tablet replica
I20260809 02:26:10.717036 2334 raft_consensus.cc:2229] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:10.717172 2334 raft_consensus.cc:2258] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:10.717792 1875 tablet_service.cc:1514] Processing DeleteTablet for tablet 27bf033e965346dbaa65689a1924c316 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:10 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:59714
I20260809 02:26:10.719358 2334 ts_tablet_manager.cc:1905] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:10.723098 2334 ts_tablet_manager.cc:1918] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:26:10.723204 2334 log.cc:1196] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/27bf033e965346dbaa65689a1924c316
I20260809 02:26:10.723475 2335 tablet_replica.cc:330] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d: stopping tablet replica
I20260809 02:26:10.723562 2334 ts_tablet_manager.cc:1939] T 27bf033e965346dbaa65689a1924c316 P c841761f04c943bc8cd4775d280ac1d6: Deleting consensus metadata
I20260809 02:26:10.723815 2335 raft_consensus.cc:2229] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:10.724015 2335 raft_consensus.cc:2258] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:10.724530 1427 catalog_manager.cc:4841] TS c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383): tablet 27bf033e965346dbaa65689a1924c316 (table test-table [id=125bf412869b43c8b761b0808320d6bf]) successfully deleted
I20260809 02:26:10.724963 2333 tablet_replica.cc:330] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17: stopping tablet replica
I20260809 02:26:10.725198 2333 raft_consensus.cc:2229] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:26:10.725278 2335 ts_tablet_manager.cc:1905] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:10.725625 2333 raft_consensus.cc:2258] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:10.726356 2333 ts_tablet_manager.cc:1905] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:10.729519 2335 ts_tablet_manager.cc:1918] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:26:10.729630 2335 log.cc:1196] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/27bf033e965346dbaa65689a1924c316
I20260809 02:26:10.729748 2333 ts_tablet_manager.cc:1918] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:26:10.729858 2333 log.cc:1196] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/wal/wals/27bf033e965346dbaa65689a1924c316
I20260809 02:26:10.730012 2335 ts_tablet_manager.cc:1939] T 27bf033e965346dbaa65689a1924c316 P b43358821f374f6a8e9526e3088afa6d: Deleting consensus metadata
I20260809 02:26:10.730211 2333 ts_tablet_manager.cc:1939] T 27bf033e965346dbaa65689a1924c316 P ea99a65250d8470fb8fcee259b37ee17: Deleting consensus metadata
I20260809 02:26:10.730871 1425 catalog_manager.cc:4841] TS ea99a65250d8470fb8fcee259b37ee17 (127.21.214.129:46205): tablet 27bf033e965346dbaa65689a1924c316 (table test-table [id=125bf412869b43c8b761b0808320d6bf]) successfully deleted
I20260809 02:26:10.730870 1424 catalog_manager.cc:4841] TS b43358821f374f6a8e9526e3088afa6d (127.21.214.130:44759): tablet 27bf033e965346dbaa65689a1924c316 (table test-table [id=125bf412869b43c8b761b0808320d6bf]) successfully deleted
Aug 09 02:26:10 dist-test-slave-68xk krb5kdc[1380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 02:26:10 dist-test-slave-68xk krb5kdc[1380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:10 dist-test-slave-68xk krb5kdc[1380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:26:10.751892 2285 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:10.744362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49748 (local address 127.21.214.190:40073)
0809 02:26:10.744497 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:10.744501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:10.744890 (+ 389us) server_negotiation.cc:407] Connection header received
0809 02:26:10.745089 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:10.745092 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:10.745156 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:10.745252 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:10.746059 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.746798 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.747761 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.748026 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.748155 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.751782 (+ 3627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49748: BlockingRecv error: recv got EOF from 127.0.0.1:49748 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 02:26:10 dist-test-slave-68xk krb5kdc[1380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM
I20260809 02:26:10.764078 2285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:10.754043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49756 (local address 127.21.214.190:40073)
0809 02:26:10.754165 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:10.754169 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:10.754632 (+ 463us) server_negotiation.cc:407] Connection header received
0809 02:26:10.754801 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:10.754804 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:10.754856 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:10.754944 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:10.755617 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.756168 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.757132 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:10.757375 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:10.757506 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:10.760384 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:10.760389 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:10.760392 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:10.760424 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:10.762080 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:10.762640 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:10.762644 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:10.762646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:10.762740 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:10.763068 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:10.763072 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:10.763073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:10.763268 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:10.763425 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:10.763709 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 02:26:10.763844 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:26:10.767045 1447 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49756:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:26:10.767572 1447 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:26:10.773151 1657 tablet_service.cc:1467] Processing CreateTablet for tablet e103f2e75e4e4c87996a3c93d43909da (DEFAULT_TABLE table=test-table [id=3802186631214afdaf6481d4b393da0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:10.773589 1657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e103f2e75e4e4c87996a3c93d43909da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:10.775022 1875 tablet_service.cc:1467] Processing CreateTablet for tablet e103f2e75e4e4c87996a3c93d43909da (DEFAULT_TABLE table=test-table [id=3802186631214afdaf6481d4b393da0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:10.775384 1875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e103f2e75e4e4c87996a3c93d43909da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:10.776775 2086 tablet_service.cc:1467] Processing CreateTablet for tablet e103f2e75e4e4c87996a3c93d43909da (DEFAULT_TABLE table=test-table [id=3802186631214afdaf6481d4b393da0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:10.777088 2086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e103f2e75e4e4c87996a3c93d43909da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:10.778232 2287 tablet_bootstrap.cc:492] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17: Bootstrap starting.
I20260809 02:26:10.778578 2286 tablet_bootstrap.cc:492] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d: Bootstrap starting.
I20260809 02:26:10.779399 2287 tablet_bootstrap.cc:654] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:10.779459 2286 tablet_bootstrap.cc:654] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:10.781536 2288 tablet_bootstrap.cc:492] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6: Bootstrap starting.
I20260809 02:26:10.782829 2288 tablet_bootstrap.cc:654] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:10.782907 2286 tablet_bootstrap.cc:492] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d: No bootstrap required, opened a new log
I20260809 02:26:10.782999 2286 ts_tablet_manager.cc:1397] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 02:26:10.783524 2286 raft_consensus.cc:348] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.783669 2286 raft_consensus.cc:374] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:10.783704 2286 raft_consensus.cc:729] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43358821f374f6a8e9526e3088afa6d, State: Initialized, Role: FOLLOWER
I20260809 02:26:10.783851 2286 consensus_queue.cc:260] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.784164 2286 ts_tablet_manager.cc:1428] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 02:26:10.784670 2287 tablet_bootstrap.cc:492] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17: No bootstrap required, opened a new log
I20260809 02:26:10.784742 2287 ts_tablet_manager.cc:1397] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260809 02:26:10.785156 2287 raft_consensus.cc:348] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.785246 2287 raft_consensus.cc:374] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:10.785269 2287 raft_consensus.cc:729] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea99a65250d8470fb8fcee259b37ee17, State: Initialized, Role: FOLLOWER
I20260809 02:26:10.785424 2287 consensus_queue.cc:260] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.788358 2287 ts_tablet_manager.cc:1428] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260809 02:26:10.790874 2288 tablet_bootstrap.cc:492] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6: No bootstrap required, opened a new log
I20260809 02:26:10.791020 2288 ts_tablet_manager.cc:1397] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260809 02:26:10.791589 2288 raft_consensus.cc:348] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.791730 2288 raft_consensus.cc:374] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:10.791779 2288 raft_consensus.cc:729] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c841761f04c943bc8cd4775d280ac1d6, State: Initialized, Role: FOLLOWER
I20260809 02:26:10.791939 2288 consensus_queue.cc:260] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.792290 2288 ts_tablet_manager.cc:1428] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:26:10.997330 2296 raft_consensus.cc:482] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:26:10.997507 2296 raft_consensus.cc:504] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:10.998103 2296 leader_election.cc:288] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ea99a65250d8470fb8fcee259b37ee17 (127.21.214.129:46205), c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383)
I20260809 02:26:10.998703 1680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e103f2e75e4e4c87996a3c93d43909da" candidate_uuid: "b43358821f374f6a8e9526e3088afa6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea99a65250d8470fb8fcee259b37ee17" is_pre_election: true
I20260809 02:26:10.998703 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e103f2e75e4e4c87996a3c93d43909da" candidate_uuid: "b43358821f374f6a8e9526e3088afa6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c841761f04c943bc8cd4775d280ac1d6" is_pre_election: true
I20260809 02:26:10.998869 2112 raft_consensus.cc:2454] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b43358821f374f6a8e9526e3088afa6d in term 0.
I20260809 02:26:10.998869 1680 raft_consensus.cc:2454] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b43358821f374f6a8e9526e3088afa6d in term 0.
I20260809 02:26:10.999274 1807 leader_election.cc:302] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43358821f374f6a8e9526e3088afa6d, c841761f04c943bc8cd4775d280ac1d6; no voters:
I20260809 02:26:10.999506 2296 raft_consensus.cc:2781] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:26:10.999575 2296 raft_consensus.cc:482] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:26:10.999629 2296 raft_consensus.cc:3037] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:11.001140 2296 raft_consensus.cc:504] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:11.001538 2296 leader_election.cc:288] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [CANDIDATE]: Term 1 election: Requested vote from peers ea99a65250d8470fb8fcee259b37ee17 (127.21.214.129:46205), c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383)
I20260809 02:26:11.001981 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e103f2e75e4e4c87996a3c93d43909da" candidate_uuid: "b43358821f374f6a8e9526e3088afa6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c841761f04c943bc8cd4775d280ac1d6"
I20260809 02:26:11.001981 1680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e103f2e75e4e4c87996a3c93d43909da" candidate_uuid: "b43358821f374f6a8e9526e3088afa6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea99a65250d8470fb8fcee259b37ee17"
I20260809 02:26:11.002135 1680 raft_consensus.cc:3037] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:11.002135 2112 raft_consensus.cc:3037] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:11.003360 2112 raft_consensus.cc:2454] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b43358821f374f6a8e9526e3088afa6d in term 1.
I20260809 02:26:11.003360 1680 raft_consensus.cc:2454] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b43358821f374f6a8e9526e3088afa6d in term 1.
I20260809 02:26:11.003705 1807 leader_election.cc:302] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43358821f374f6a8e9526e3088afa6d, c841761f04c943bc8cd4775d280ac1d6; no voters:
I20260809 02:26:11.003978 2296 raft_consensus.cc:2781] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:11.004096 2296 raft_consensus.cc:686] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [term 1 LEADER]: Becoming Leader. State: Replica: b43358821f374f6a8e9526e3088afa6d, State: Running, Role: LEADER
I20260809 02:26:11.004253 2296 consensus_queue.cc:237] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:11.006546 1447 catalog_manager.cc:5495] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d reported cstate change: term changed from 0 to 1, leader changed from <none> to b43358821f374f6a8e9526e3088afa6d (127.21.214.130). New cstate: current_term: 1 leader_uuid: "b43358821f374f6a8e9526e3088afa6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } health_report { overall_health: UNKNOWN } } }
I20260809 02:26:11.029633 2221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:11.026449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59752 (local address 127.21.214.130:44759)
0809 02:26:11.026585 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:11.026595 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:11.026610 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:26:11.026719 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:11.026722 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:11.026766 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:11.026831 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:26:11.027112 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:11.027642 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:11.028583 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:11.028808 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:11.028895 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:11.029129 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:26:11.029237 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:26:11.029296 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:11.029416 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 02:26:11.029463 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:26:11.031919 2112 raft_consensus.cc:1261] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Refusing update from remote peer b43358821f374f6a8e9526e3088afa6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:11.031927 1680 raft_consensus.cc:1261] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Refusing update from remote peer b43358821f374f6a8e9526e3088afa6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:11.032404 2322 consensus_queue.cc:1035] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:11.032563 2296 consensus_queue.cc:1035] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:11.039527 1444 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:11.039705 1444 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:11.041941 1444 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e: Sending DeleteTablet for 3 replicas of tablet e103f2e75e4e4c87996a3c93d43909da
I20260809 02:26:11.042600 1875 tablet_service.cc:1514] Processing DeleteTablet for tablet e103f2e75e4e4c87996a3c93d43909da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:11 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:59714
I20260809 02:26:11.042611 1657 tablet_service.cc:1514] Processing DeleteTablet for tablet e103f2e75e4e4c87996a3c93d43909da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:11 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:56166
I20260809 02:26:11.042790 2335 tablet_replica.cc:330] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d: stopping tablet replica
I20260809 02:26:11.042790 2333 tablet_replica.cc:330] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17: stopping tablet replica
I20260809 02:26:11.042910 2335 raft_consensus.cc:2229] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:26:11.042907 2333 raft_consensus.cc:2229] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:11.043030 2333 raft_consensus.cc:2258] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:11.043107 2335 raft_consensus.cc:2258] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:11.043723 2086 tablet_service.cc:1514] Processing DeleteTablet for tablet e103f2e75e4e4c87996a3c93d43909da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:11 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:45986
I20260809 02:26:11.043850 2335 ts_tablet_manager.cc:1905] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:11.043895 2083 tablet_service.cc:1514] Processing DeleteTablet for tablet e103f2e75e4e4c87996a3c93d43909da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:11 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:45986
I20260809 02:26:11.044056 1444 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49756:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:26:11.044456 1444 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:26:11.045715 2333 ts_tablet_manager.cc:1905] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:11.046478 2335 ts_tablet_manager.cc:1918] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:26:11.046577 2335 log.cc:1196] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/e103f2e75e4e4c87996a3c93d43909da
I20260809 02:26:11.046875 2335 ts_tablet_manager.cc:1939] T e103f2e75e4e4c87996a3c93d43909da P b43358821f374f6a8e9526e3088afa6d: Deleting consensus metadata
I20260809 02:26:11.047627 2334 tablet_replica.cc:330] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6: stopping tablet replica
I20260809 02:26:11.047622 1424 catalog_manager.cc:4841] TS b43358821f374f6a8e9526e3088afa6d (127.21.214.130:44759): tablet e103f2e75e4e4c87996a3c93d43909da (table test-table [id=3802186631214afdaf6481d4b393da0d]) successfully deleted
I20260809 02:26:11.047763 2334 raft_consensus.cc:2229] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:11.047910 2334 raft_consensus.cc:2258] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:11.048588 2334 ts_tablet_manager.cc:1905] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:11.048694 2333 ts_tablet_manager.cc:1918] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:26:11.048777 2333 log.cc:1196] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-0/wal/wals/e103f2e75e4e4c87996a3c93d43909da
I20260809 02:26:11.049067 2333 ts_tablet_manager.cc:1939] T e103f2e75e4e4c87996a3c93d43909da P ea99a65250d8470fb8fcee259b37ee17: Deleting consensus metadata
I20260809 02:26:11.049757 1425 catalog_manager.cc:4841] TS ea99a65250d8470fb8fcee259b37ee17 (127.21.214.129:46205): tablet e103f2e75e4e4c87996a3c93d43909da (table test-table [id=3802186631214afdaf6481d4b393da0d]) successfully deleted
I20260809 02:26:11.051307 1657 tablet_service.cc:1467] Processing CreateTablet for tablet 772d52eb0226404f9c17c39691725893 (DEFAULT_TABLE table=test-table [id=0046515c916644b994a3f083700c1bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:11.051457 1875 tablet_service.cc:1467] Processing CreateTablet for tablet 772d52eb0226404f9c17c39691725893 (DEFAULT_TABLE table=test-table [id=0046515c916644b994a3f083700c1bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:11.051571 1657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 772d52eb0226404f9c17c39691725893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:11.051697 1875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 772d52eb0226404f9c17c39691725893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:11.053884 2286 tablet_bootstrap.cc:492] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d: Bootstrap starting.
I20260809 02:26:11.053889 2334 ts_tablet_manager.cc:1918] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:26:11.053973 2334 log.cc:1196] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/e103f2e75e4e4c87996a3c93d43909da
I20260809 02:26:11.054248 2334 ts_tablet_manager.cc:1939] T e103f2e75e4e4c87996a3c93d43909da P c841761f04c943bc8cd4775d280ac1d6: Deleting consensus metadata
I20260809 02:26:11.054796 2286 tablet_bootstrap.cc:654] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:11.055243 1427 catalog_manager.cc:4841] TS c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383): tablet e103f2e75e4e4c87996a3c93d43909da (table test-table [id=3802186631214afdaf6481d4b393da0d]) successfully deleted
I20260809 02:26:11.055385 2287 tablet_bootstrap.cc:492] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17: Bootstrap starting.
I20260809 02:26:11.055508 2083 tablet_service.cc:1467] Processing CreateTablet for tablet 772d52eb0226404f9c17c39691725893 (DEFAULT_TABLE table=test-table [id=0046515c916644b994a3f083700c1bcf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260809 02:26:11.055562 1427 catalog_manager.cc:4808] TS c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383): delete failed for tablet e103f2e75e4e4c87996a3c93d43909da because the tablet was not found. No further retry: Not found: Tablet not found: e103f2e75e4e4c87996a3c93d43909da
I20260809 02:26:11.055749 2083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 772d52eb0226404f9c17c39691725893. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:11.056236 2287 tablet_bootstrap.cc:654] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:11.056494 2286 tablet_bootstrap.cc:492] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d: No bootstrap required, opened a new log
I20260809 02:26:11.056600 2286 ts_tablet_manager.cc:1397] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 02:26:11.057091 2286 raft_consensus.cc:348] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:11.057211 2286 raft_consensus.cc:374] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:11.057283 2286 raft_consensus.cc:729] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43358821f374f6a8e9526e3088afa6d, State: Initialized, Role: FOLLOWER
I20260809 02:26:11.057394 2287 tablet_bootstrap.cc:492] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17: No bootstrap required, opened a new log
I20260809 02:26:11.057421 2286 consensus_queue.cc:260] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:11.057485 2287 ts_tablet_manager.cc:1397] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 02:26:11.057967 2286 ts_tablet_manager.cc:1428] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260809 02:26:11.058032 2287 raft_consensus.cc:348] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:11.058136 2287 raft_consensus.cc:374] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:11.058169 2287 raft_consensus.cc:729] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea99a65250d8470fb8fcee259b37ee17, State: Initialized, Role: FOLLOWER
I20260809 02:26:11.058352 2288 tablet_bootstrap.cc:492] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6: Bootstrap starting.
I20260809 02:26:11.058300 2287 consensus_queue.cc:260] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:11.058607 2287 ts_tablet_manager.cc:1428] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 02:26:11.059296 2288 tablet_bootstrap.cc:654] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:11.060662 2288 tablet_bootstrap.cc:492] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6: No bootstrap required, opened a new log
I20260809 02:26:11.060753 2288 ts_tablet_manager.cc:1397] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 02:26:11.061228 2288 raft_consensus.cc:348] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:11.061345 2288 raft_consensus.cc:374] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:11.061378 2288 raft_consensus.cc:729] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c841761f04c943bc8cd4775d280ac1d6, State: Initialized, Role: FOLLOWER
I20260809 02:26:11.061518 2288 consensus_queue.cc:260] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:11.061817 2288 ts_tablet_manager.cc:1428] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 02:26:11.161559 2274 raft_consensus.cc:482] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:26:11.161717 2274 raft_consensus.cc:504] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:11.162150 2274 leader_election.cc:288] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b43358821f374f6a8e9526e3088afa6d (127.21.214.130:44759), c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383)
I20260809 02:26:11.162778 1904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "772d52eb0226404f9c17c39691725893" candidate_uuid: "ea99a65250d8470fb8fcee259b37ee17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b43358821f374f6a8e9526e3088afa6d" is_pre_election: true
I20260809 02:26:11.162778 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "772d52eb0226404f9c17c39691725893" candidate_uuid: "ea99a65250d8470fb8fcee259b37ee17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c841761f04c943bc8cd4775d280ac1d6" is_pre_election: true
I20260809 02:26:11.162945 1904 raft_consensus.cc:2454] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea99a65250d8470fb8fcee259b37ee17 in term 0.
I20260809 02:26:11.162945 2112 raft_consensus.cc:2454] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea99a65250d8470fb8fcee259b37ee17 in term 0.
I20260809 02:26:11.163298 1582 leader_election.cc:302] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43358821f374f6a8e9526e3088afa6d, ea99a65250d8470fb8fcee259b37ee17; no voters:
I20260809 02:26:11.163491 2274 raft_consensus.cc:2781] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:26:11.163564 2274 raft_consensus.cc:482] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:26:11.163594 2274 raft_consensus.cc:3037] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:11.164700 2274 raft_consensus.cc:504] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:11.165050 2274 leader_election.cc:288] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [CANDIDATE]: Term 1 election: Requested vote from peers b43358821f374f6a8e9526e3088afa6d (127.21.214.130:44759), c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383)
I20260809 02:26:11.165517 1904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "772d52eb0226404f9c17c39691725893" candidate_uuid: "ea99a65250d8470fb8fcee259b37ee17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b43358821f374f6a8e9526e3088afa6d"
I20260809 02:26:11.165517 2112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "772d52eb0226404f9c17c39691725893" candidate_uuid: "ea99a65250d8470fb8fcee259b37ee17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c841761f04c943bc8cd4775d280ac1d6"
I20260809 02:26:11.165669 1904 raft_consensus.cc:3037] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:11.165669 2112 raft_consensus.cc:3037] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:11.166945 2112 raft_consensus.cc:2454] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea99a65250d8470fb8fcee259b37ee17 in term 1.
I20260809 02:26:11.166945 1904 raft_consensus.cc:2454] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea99a65250d8470fb8fcee259b37ee17 in term 1.
I20260809 02:26:11.167256 1582 leader_election.cc:302] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43358821f374f6a8e9526e3088afa6d, ea99a65250d8470fb8fcee259b37ee17; no voters:
I20260809 02:26:11.167454 2274 raft_consensus.cc:2781] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:11.167563 2274 raft_consensus.cc:686] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [term 1 LEADER]: Becoming Leader. State: Replica: ea99a65250d8470fb8fcee259b37ee17, State: Running, Role: LEADER
I20260809 02:26:11.167707 2274 consensus_queue.cc:237] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } }
I20260809 02:26:11.169595 1447 catalog_manager.cc:5495] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea99a65250d8470fb8fcee259b37ee17 (127.21.214.129). New cstate: current_term: 1 leader_uuid: "ea99a65250d8470fb8fcee259b37ee17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ea99a65250d8470fb8fcee259b37ee17" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 } health_report { overall_health: UNKNOWN } } }
I20260809 02:26:11.193876 2368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:11.190578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56174 (local address 127.21.214.129:46205)
0809 02:26:11.190840 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:11.190843 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:11.190859 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:26:11.190900 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:11.190903 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:11.190946 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:11.191024 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:26:11.191279 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:11.191908 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:11.192754 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:11.192995 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:11.193118 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:11.193345 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:26:11.193416 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:26:11.193476 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:11.193600 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 02:26:11.193652 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":100,"threads_started":1}
I20260809 02:26:11.200237 1904 raft_consensus.cc:1261] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Refusing update from remote peer ea99a65250d8470fb8fcee259b37ee17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:11.200356 2112 raft_consensus.cc:1261] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Refusing update from remote peer ea99a65250d8470fb8fcee259b37ee17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:11.200640 2328 consensus_queue.cc:1035] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b43358821f374f6a8e9526e3088afa6d" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 44759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:11.200889 2274 consensus_queue.cc:1035] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c841761f04c943bc8cd4775d280ac1d6" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:11.233258 1444 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:11.233431 1444 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:11.235522 1444 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 48ad0c41a8084732a5ae0d24d4d72b2e: Sending DeleteTablet for 3 replicas of tablet 772d52eb0226404f9c17c39691725893
I20260809 02:26:11.236090 1657 tablet_service.cc:1514] Processing DeleteTablet for tablet 772d52eb0226404f9c17c39691725893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:11 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:56166
I20260809 02:26:11.236159 1875 tablet_service.cc:1514] Processing DeleteTablet for tablet 772d52eb0226404f9c17c39691725893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:11 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:59714
I20260809 02:26:11.236269 2083 tablet_service.cc:1514] Processing DeleteTablet for tablet 772d52eb0226404f9c17c39691725893 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:11 UTC) from {username='oryx', principal='oryx/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:45986
I20260809 02:26:11.236398 2333 tablet_replica.cc:330] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17: stopping tablet replica
I20260809 02:26:11.236474 2334 tablet_replica.cc:330] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6: stopping tablet replica
I20260809 02:26:11.236536 2333 raft_consensus.cc:2229] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:26:11.236591 2334 raft_consensus.cc:2229] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:11.236701 2334 raft_consensus.cc:2258] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:11.236702 2333 raft_consensus.cc:2258] T 772d52eb0226404f9c17c39691725893 P ea99a65250d8470fb8fcee259b37ee17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:11.236917 2335 tablet_replica.cc:330] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d: stopping tablet replica
I20260809 02:26:11.237037 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 1555
I20260809 02:26:11.237052 2335 raft_consensus.cc:2229] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:11.237186 2335 raft_consensus.cc:2258] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:11.245213 2334 ts_tablet_manager.cc:1905] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:11.247041 2335 ts_tablet_manager.cc:1905] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:11.248252 2334 ts_tablet_manager.cc:1918] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:26:11.248350 2334 log.cc:1196] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/772d52eb0226404f9c17c39691725893
I20260809 02:26:11.248656 2334 ts_tablet_manager.cc:1939] T 772d52eb0226404f9c17c39691725893 P c841761f04c943bc8cd4775d280ac1d6: Deleting consensus metadata
I20260809 02:26:11.249409 1427 catalog_manager.cc:4841] TS c841761f04c943bc8cd4775d280ac1d6 (127.21.214.131:34383): tablet 772d52eb0226404f9c17c39691725893 (table test-table [id=0046515c916644b994a3f083700c1bcf]) successfully deleted
I20260809 02:26:11.249624 2335 ts_tablet_manager.cc:1918] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 02:26:11.249706 2335 log.cc:1196] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/772d52eb0226404f9c17c39691725893
I20260809 02:26:11.250026 2335 ts_tablet_manager.cc:1939] T 772d52eb0226404f9c17c39691725893 P b43358821f374f6a8e9526e3088afa6d: Deleting consensus metadata
I20260809 02:26:11.250630 1424 catalog_manager.cc:4841] TS b43358821f374f6a8e9526e3088afa6d (127.21.214.130:44759): tablet 772d52eb0226404f9c17c39691725893 (table test-table [id=0046515c916644b994a3f083700c1bcf]) successfully deleted
W20260809 02:26:11.256806 1425 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:46205 (error 108)
I20260809 02:26:11.257054 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 1770
I20260809 02:26:11.257942 2376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:11.257519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:46205 (local address 127.0.0.1:56182)
0809 02:26:11.257739 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:11.257820 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:46205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":63,"threads_started":1}
W20260809 02:26:11.259254 1425 catalog_manager.cc:4584] TS ea99a65250d8470fb8fcee259b37ee17 (127.21.214.129:46205): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 772d52eb0226404f9c17c39691725893: Network error: Client connection negotiation failed: client connection to 127.21.214.129:46205: connect: Connection refused (error 111)
I20260809 02:26:11.273882 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 1986
I20260809 02:26:11.284183 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 1403
2026-08-09T02:26:11Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3696 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:26:11 dist-test-slave-68xk krb5kdc[2381](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:26:11 dist-test-slave-68xk krb5kdc[2381](info): set up 2 sockets
Aug 09 02:26:11 dist-test-slave-68xk krb5kdc[2381](info): commencing operation
krb5kdc: starting...
W20260809 02:26:12.599116 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:26:12 dist-test-slave-68xk krb5kdc[2381](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:26:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:26:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:26:12.738013 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:44713
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:44713
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:12.850524 2400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:12.850852 2400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:12.850925 2400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:12.854935 2400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:26:12.855028 2400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:12.855062 2400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:12.855103 2400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:26:12.855139 2400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:26:12.860389 2400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:44713
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:44713
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:12.861454 2400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:12.862511 2400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:12.871028 2408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:12.871238 2400 server_base.cc:1034] running on GCE node
W20260809 02:26:12.871044 2407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:12.871050 2411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:12.871905 2400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:12.872967 2400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:12.874166 2400 hybrid_clock.cc:648] HybridClock initialized: now 1786242372874139 us; error 37 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T02:26:12Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1590 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:26:12 dist-test-slave-68xk krb5kdc[2419](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:26:12 dist-test-slave-68xk krb5kdc[2419](info): set up 2 sockets
Aug 09 02:26:12 dist-test-slave-68xk krb5kdc[2419](info): commencing operation
krb5kdc: starting...
W20260809 02:26:14.119222 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:26:14 dist-test-slave-68xk krb5kdc[2419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:26:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:26:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:26:14.273205 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:46545
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:46545
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:14.389097 2435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:14.389362 2435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:14.389403 2435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:14.393399 2435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:26:14.393460 2435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:14.393479 2435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:14.393496 2435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:26:14.393510 2435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:26:14.399430 2435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:46545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:46545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:14.400476 2435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:14.401525 2435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:14.410311 2448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:14.410375 2446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:14.410284 2443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:14.410743 2435 server_base.cc:1034] running on GCE node
I20260809 02:26:14.411304 2435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:14.412354 2435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:14.413549 2435 hybrid_clock.cc:648] HybridClock initialized: now 1786242374413529 us; error 32 us; skew 500 ppm
Aug 09 02:26:14 dist-test-slave-68xk krb5kdc[2419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242374, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:14.416433 2435 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:26:14.417322 2435 webserver.cc:460] Webserver started at http://127.21.214.190:37059/ using document root <none> and password file <none>
I20260809 02:26:14.417894 2435 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:14.417959 2435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:14.418193 2435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:14.420486 2435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "60dddb43c073459ba490786115bb3045"
format_stamp: "Formatted at 2026-08-09 02:26:14 on dist-test-slave-68xk"
server_key: "5f6fdf0e6c1c93fcf47817aaa5575ded"
server_key_iv: "11d64f9b22f8c66e29e6a85660ef17d8"
server_key_version: "encryptionkey@0"
I20260809 02:26:14.421062 2435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "60dddb43c073459ba490786115bb3045"
format_stamp: "Formatted at 2026-08-09 02:26:14 on dist-test-slave-68xk"
server_key: "5f6fdf0e6c1c93fcf47817aaa5575ded"
server_key_iv: "11d64f9b22f8c66e29e6a85660ef17d8"
server_key_version: "encryptionkey@0"
I20260809 02:26:14.424839 2435 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 02:26:14.427369 2456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:14.428606 2435 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:26:14.428761 2435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "60dddb43c073459ba490786115bb3045"
format_stamp: "Formatted at 2026-08-09 02:26:14 on dist-test-slave-68xk"
server_key: "5f6fdf0e6c1c93fcf47817aaa5575ded"
server_key_iv: "11d64f9b22f8c66e29e6a85660ef17d8"
server_key_version: "encryptionkey@0"
I20260809 02:26:14.428874 2435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:14.461594 2435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:14.464824 2435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:14.465060 2435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:14.473659 2435 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:46545
I20260809 02:26:14.473737 2531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:46545 every 8 connection(s)
I20260809 02:26:14.474779 2435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:26:14.477660 2532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:14.480552 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 2435
I20260809 02:26:14.480700 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:26:14.481038 22362 external_mini_cluster.cc:1428] Setting key 7545f5244636b9d6de523d808f7d77c7
I20260809 02:26:14.484179 2532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045: Bootstrap starting.
I20260809 02:26:14.486593 2532 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:14.487406 2532 log.cc:824] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:14.489912 2532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045: No bootstrap required, opened a new log
Aug 09 02:26:14 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242374, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:26:14.493888 2532 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60dddb43c073459ba490786115bb3045" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 46545 } }
I20260809 02:26:14.494155 2532 raft_consensus.cc:374] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:14.494227 2532 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60dddb43c073459ba490786115bb3045, State: Initialized, Role: FOLLOWER
I20260809 02:26:14.494757 2532 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60dddb43c073459ba490786115bb3045" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 46545 } }
I20260809 02:26:14.494894 2532 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:26:14.494983 2532 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:26:14.495080 2532 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:14.496467 2532 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60dddb43c073459ba490786115bb3045" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 46545 } }
I20260809 02:26:14.496831 2532 leader_election.cc:302] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60dddb43c073459ba490786115bb3045; no voters:
I20260809 02:26:14.497152 2532 leader_election.cc:288] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:26:14.497280 2538 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:14.497356 2536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:14.482567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36714 (local address 127.21.214.190:46545)
0809 02:26:14.483034 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:14.483048 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:14.483085 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:26:14.483702 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:14.483718 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:14.484042 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:14.484385 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:14.485239 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:14.486244 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:14.487275 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:14.487849 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:14.488035 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:14.490941 (+ 2906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:14.490946 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:14.490959 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:14.490986 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:14.493717 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:14.494229 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:14.494237 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:14.494244 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:14.494383 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:14.494728 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:14.494732 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:14.494734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:14.495285 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:14.495503 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:14.495929 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 02:26:14.496374 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":134,"threads_started":1}
I20260809 02:26:14.497510 2538 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 1 LEADER]: Becoming Leader. State: Replica: 60dddb43c073459ba490786115bb3045, State: Running, Role: LEADER
I20260809 02:26:14.497850 2538 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60dddb43c073459ba490786115bb3045" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 46545 } }
I20260809 02:26:14.498601 2532 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:26:14.499125 2538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60dddb43c073459ba490786115bb3045. Latest consensus state: current_term: 1 leader_uuid: "60dddb43c073459ba490786115bb3045" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60dddb43c073459ba490786115bb3045" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 46545 } } }
I20260809 02:26:14.499329 2538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:14.499789 2545 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:26:14.500845 2540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60dddb43c073459ba490786115bb3045" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60dddb43c073459ba490786115bb3045" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 46545 } } }
I20260809 02:26:14.500967 2540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:14.503548 2545 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:26:14.509406 2545 catalog_manager.cc:1347] Generated new cluster ID: 751b4bb00ac749f4a7cd75271326662b
I20260809 02:26:14.509483 2545 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:26:14.532897 2545 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:26:14.534241 2545 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:26:14.538852 2545 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045: Generated new TSK 0
I20260809 02:26:14.539692 2545 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:26:14.582912 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:46545
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:14.702493 2566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:14.702777 2566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:14.702850 2566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:14.706836 2566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:14.706924 2566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:14.707010 2566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:26:14.712368 2566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:46545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:14.713454 2566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:14.714515 2566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:14.724613 2573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:14.724736 2566 server_base.cc:1034] running on GCE node
W20260809 02:26:14.724606 2574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:14.724681 2577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:14.725304 2566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:14.725970 2566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:14.727156 2566 hybrid_clock.cc:648] HybridClock initialized: now 1786242374727131 us; error 41 us; skew 500 ppm
Aug 09 02:26:14 dist-test-slave-68xk krb5kdc[2419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242374, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:14.730034 2566 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:26:14.731014 2566 webserver.cc:460] Webserver started at http://127.21.214.129:32885/ using document root <none> and password file <none>
I20260809 02:26:14.731613 2566 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:14.731716 2566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:14.732018 2566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:14.734163 2566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "94e2c341c375431291fc21ae3211e227"
format_stamp: "Formatted at 2026-08-09 02:26:14 on dist-test-slave-68xk"
server_key: "ec2cffd50fed9fe12ad5ae238f234da0"
server_key_iv: "7d855d13fdb3f6a01aa976b92f8f1a14"
server_key_version: "encryptionkey@0"
I20260809 02:26:14.734754 2566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "94e2c341c375431291fc21ae3211e227"
format_stamp: "Formatted at 2026-08-09 02:26:14 on dist-test-slave-68xk"
server_key: "ec2cffd50fed9fe12ad5ae238f234da0"
server_key_iv: "7d855d13fdb3f6a01aa976b92f8f1a14"
server_key_version: "encryptionkey@0"
I20260809 02:26:14.738463 2566 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:26:14.740912 2587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:14.742079 2566 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:26:14.742218 2566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "94e2c341c375431291fc21ae3211e227"
format_stamp: "Formatted at 2026-08-09 02:26:14 on dist-test-slave-68xk"
server_key: "ec2cffd50fed9fe12ad5ae238f234da0"
server_key_iv: "7d855d13fdb3f6a01aa976b92f8f1a14"
server_key_version: "encryptionkey@0"
I20260809 02:26:14.742328 2566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:14.759855 2566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:14.762837 2566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:14.763041 2566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:14.763659 2566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:14.764497 2566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:14.764581 2566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:14.764657 2566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:14.764716 2566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:14.774096 2566 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:44929
I20260809 02:26:14.774119 2746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:44929 every 8 connection(s)
I20260809 02:26:14.775034 2566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:26:14.780385 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 2566
I20260809 02:26:14.780519 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:26:14.780825 22362 external_mini_cluster.cc:1428] Setting key c606d5ff25c7b5cb00ff8409a509678a
Aug 09 02:26:14 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242374, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:26:14.789713 2536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:14.776926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:35847 (local address 127.21.214.190:46545)
0809 02:26:14.777062 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:14.777066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:14.777901 (+ 835us) server_negotiation.cc:407] Connection header received
0809 02:26:14.779355 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:14.779359 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:14.779420 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:14.779499 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:14.780762 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:14.781477 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:14.782841 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:14.783101 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:14.783215 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:14.786082 (+ 2867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:14.786093 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:14.786096 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:14.786119 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:14.787608 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:14.788140 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:14.788144 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:14.788145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:14.788227 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:14.788577 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:14.788582 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:14.788584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:14.788774 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:14.788888 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:14.789402 (+ 514us) server_negotiation.cc:299] Negotiation successful
0809 02:26:14.789535 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:26:14.790614 2751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:14.777301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:35847)
0809 02:26:14.777748 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:14.777790 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:14.779129 (+ 1339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:14.779664 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:14.779670 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:14.780034 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:14.780590 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:14.780619 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:14.781617 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:14.781621 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:14.782715 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:14.782724 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:14.783274 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:14.783279 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:14.783444 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:14.784076 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:14.784092 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:14.785914 (+ 1822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:14.787735 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:14.787740 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:14.787755 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:14.788017 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:14.788324 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:14.788327 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:14.788330 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:14.788476 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:14.788889 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:14.788896 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:14.789160 (+ 264us) client_negotiation.cc:769] Sending connection context
0809 02:26:14.789358 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 02:26:14.789688 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":128,"threads_started":1}
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:26:14.791975 2748 heartbeater.cc:347] Connected to a master server at 127.21.214.190:46545
I20260809 02:26:14.792235 2748 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:14.792805 2748 heartbeater.cc:511] Master 127.21.214.190:46545 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
I20260809 02:26:14.794871 2483 ts_manager.cc:194] Registered new tserver with Master: 94e2c341c375431291fc21ae3211e227 (127.21.214.129:44929)
I20260809 02:26:14.796538 2483 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:35847
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:26:14.813555 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:46545
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:14.931411 2755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:14.931697 2755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:14.931789 2755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:14.935902 2755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:14.935983 2755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:14.936072 2755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:26:14.941224 2755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:46545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:14.942279 2755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:14.943373 2755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:14.953522 2762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:14.953504 2764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:14.953508 2766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:14.953886 2755 server_base.cc:1034] running on GCE node
I20260809 02:26:14.954561 2755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:14.955271 2755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:14.956487 2755 hybrid_clock.cc:648] HybridClock initialized: now 1786242374956469 us; error 31 us; skew 500 ppm
Aug 09 02:26:14 dist-test-slave-68xk krb5kdc[2419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242374, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:14.959761 2755 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:26:14.960721 2755 webserver.cc:460] Webserver started at http://127.21.214.130:36083/ using document root <none> and password file <none>
I20260809 02:26:14.961285 2755 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:14.961352 2755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:14.961531 2755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:14.963822 2755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "5dd6e2ea3ddd4193ba1f02e7049ede93"
format_stamp: "Formatted at 2026-08-09 02:26:14 on dist-test-slave-68xk"
server_key: "473919bfdf108d30ab89e24e6fd7c5d1"
server_key_iv: "f458e1d33118c9f58b04496c10621fae"
server_key_version: "encryptionkey@0"
I20260809 02:26:14.964406 2755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "5dd6e2ea3ddd4193ba1f02e7049ede93"
format_stamp: "Formatted at 2026-08-09 02:26:14 on dist-test-slave-68xk"
server_key: "473919bfdf108d30ab89e24e6fd7c5d1"
server_key_iv: "f458e1d33118c9f58b04496c10621fae"
server_key_version: "encryptionkey@0"
I20260809 02:26:14.968567 2755 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:26:14.971232 2781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:14.972467 2755 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:26:14.972611 2755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "5dd6e2ea3ddd4193ba1f02e7049ede93"
format_stamp: "Formatted at 2026-08-09 02:26:14 on dist-test-slave-68xk"
server_key: "473919bfdf108d30ab89e24e6fd7c5d1"
server_key_iv: "f458e1d33118c9f58b04496c10621fae"
server_key_version: "encryptionkey@0"
I20260809 02:26:14.972736 2755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:14.991366 2755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:14.994756 2755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:14.994974 2755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:14.995618 2755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:14.996615 2755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:14.996711 2755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:14.996793 2755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:14.996845 2755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:15.008286 2755 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:33569
I20260809 02:26:15.008494 2946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:33569 every 8 connection(s)
I20260809 02:26:15.009555 2755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:26:15.011301 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 2755
I20260809 02:26:15.011441 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:26:15.011961 22362 external_mini_cluster.cc:1428] Setting key 6d133395f53aa71a81a3c86445fdeffb
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242374, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
I20260809 02:26:15.027580 2536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:15.012123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:39379 (local address 127.21.214.190:46545)
0809 02:26:15.012261 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:15.012266 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:15.013165 (+ 899us) server_negotiation.cc:407] Connection header received
0809 02:26:15.015144 (+ 1979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:15.015147 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:15.015195 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:15.015275 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:15.016688 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.017490 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.019402 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.019645 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.019739 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.022740 (+ 3001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:15.022743 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:15.022745 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:15.022769 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:15.024699 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:15.025650 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:15.025657 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:15.025662 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:15.025793 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:15.026215 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:15.026218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:15.026220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:15.026516 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:15.026669 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:15.027224 (+ 555us) server_negotiation.cc:299] Negotiation successful
0809 02:26:15.027371 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:26:15.028465 2951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:15.012479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:39379)
0809 02:26:15.012992 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:15.013047 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:15.014894 (+ 1847us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:15.015453 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:15.015466 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:15.016017 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:15.016517 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.016531 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.017633 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.017640 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.019241 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.019257 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.019820 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.019827 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.020069 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.020740 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:15.020768 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:15.022568 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:15.024838 (+ 2270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:15.024845 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:15.024861 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:15.025171 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:15.025905 (+ 734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:15.025911 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:15.025915 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:15.026107 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:15.026665 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:15.026672 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:15.026943 (+ 271us) client_negotiation.cc:769] Sending connection context
0809 02:26:15.027155 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 02:26:15.027510 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":140,"threads_started":1}
I20260809 02:26:15.029788 2948 heartbeater.cc:347] Connected to a master server at 127.21.214.190:46545
I20260809 02:26:15.030064 2948 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:15.030681 2948 heartbeater.cc:511] Master 127.21.214.190:46545 requested a full tablet report, sending...
I20260809 02:26:15.031988 2483 ts_manager.cc:194] Registered new tserver with Master: 5dd6e2ea3ddd4193ba1f02e7049ede93 (127.21.214.130:33569)
I20260809 02:26:15.032886 2483 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:39379
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:26:15.042979 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:46545
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:15.155531 2954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:15.155774 2954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:15.155814 2954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:15.159786 2954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:15.159837 2954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:15.159925 2954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:26:15.164991 2954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:46545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:15.165963 2954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:15.166985 2954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:15.176838 2960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:15.176827 2964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:15.176827 2962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:15.177080 2954 server_base.cc:1034] running on GCE node
I20260809 02:26:15.177569 2954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:15.178246 2954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:15.179418 2954 hybrid_clock.cc:648] HybridClock initialized: now 1786242375179398 us; error 31 us; skew 500 ppm
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242375, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:15.182242 2954 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:26:15.183223 2954 webserver.cc:460] Webserver started at http://127.21.214.131:38881/ using document root <none> and password file <none>
I20260809 02:26:15.183818 2954 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:15.183914 2954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:15.184158 2954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:15.186257 2954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "18504ed6abe24177b878562394fea58b"
format_stamp: "Formatted at 2026-08-09 02:26:15 on dist-test-slave-68xk"
server_key: "a65bb6c6a5e8c57d0c05ccfeba008bc6"
server_key_iv: "6f8a65ced3155096e035b76af2f52b8a"
server_key_version: "encryptionkey@0"
I20260809 02:26:15.186908 2954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "18504ed6abe24177b878562394fea58b"
format_stamp: "Formatted at 2026-08-09 02:26:15 on dist-test-slave-68xk"
server_key: "a65bb6c6a5e8c57d0c05ccfeba008bc6"
server_key_iv: "6f8a65ced3155096e035b76af2f52b8a"
server_key_version: "encryptionkey@0"
I20260809 02:26:15.190806 2954 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 02:26:15.193276 2976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:15.194711 2954 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:26:15.194866 2954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "18504ed6abe24177b878562394fea58b"
format_stamp: "Formatted at 2026-08-09 02:26:15 on dist-test-slave-68xk"
server_key: "a65bb6c6a5e8c57d0c05ccfeba008bc6"
server_key_iv: "6f8a65ced3155096e035b76af2f52b8a"
server_key_version: "encryptionkey@0"
I20260809 02:26:15.194989 2954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:15.206766 2954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:15.209957 2954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:15.210167 2954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:15.210913 2954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:15.211782 2954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:15.211831 2954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:15.211897 2954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:15.211931 2954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:15.220698 2954 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:36975
I20260809 02:26:15.220775 3129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:36975 every 8 connection(s)
I20260809 02:26:15.221607 2954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:26:15.229449 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 2954
I20260809 02:26:15.229628 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:26:15.229951 22362 external_mini_cluster.cc:1428] Setting key 8c719cec8fc2ef57262fe6d4902aa1ec
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242375, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:26:15.235347 2536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:15.223493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:47473 (local address 127.21.214.190:46545)
0809 02:26:15.223626 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:15.223629 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:15.224860 (+ 1231us) server_negotiation.cc:407] Connection header received
0809 02:26:15.225772 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:15.225775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:15.225837 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:15.225942 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:15.227156 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.227699 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.228855 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.229087 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.229198 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.231989 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:15.231997 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:15.231999 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:15.232022 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:15.233417 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:15.233929 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:15.233932 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:15.233933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:15.234010 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:15.234352 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:15.234354 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:15.234355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:15.234582 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:15.234662 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:15.235125 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 02:26:15.235228 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:26:15.236176 3133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:15.223821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:47473)
0809 02:26:15.224695 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:15.224753 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:15.225558 (+ 805us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:15.226116 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:15.226123 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:15.226537 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:15.227005 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.227019 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.227842 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.227846 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.228709 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.228719 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.229272 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.229277 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.229444 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.230118 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:15.230141 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:15.231823 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:15.233557 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:15.233561 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:15.233572 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:15.233837 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:15.234093 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:15.234095 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:15.234097 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:15.234267 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:15.234678 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:15.234683 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:15.234906 (+ 223us) client_negotiation.cc:769] Sending connection context
0809 02:26:15.235076 (+ 170us) client_negotiation.cc:240] Negotiation successful
0809 02:26:15.235363 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"thread_start_us":531,"threads_started":1}
I20260809 02:26:15.237287 3130 heartbeater.cc:347] Connected to a master server at 127.21.214.190:46545
I20260809 02:26:15.237495 3130 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:15.237931 3130 heartbeater.cc:511] Master 127.21.214.190:46545 requested a full tablet report, sending...
I20260809 02:26:15.238924 2483 ts_manager.cc:194] Registered new tserver with Master: 18504ed6abe24177b878562394fea58b (127.21.214.131:36975)
I20260809 02:26:15.239439 2483 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:47473
I20260809 02:26:15.243942 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab.
Entry for principal oryx/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab.
WARNING: no policy specified for oryx/127.21.214.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab.
Entry for principal oryx/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab.
WARNING: no policy specified for oryx/127.21.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.21.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab.
Entry for principal oryx/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab.
I20260809 02:26:15.326728 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 2566
I20260809 02:26:15.335983 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 2755
I20260809 02:26:15.364419 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 2954
I20260809 02:26:15.375993 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 2435
I20260809 02:26:15.388185 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:46545
--webserver_interface=127.21.214.190
--webserver_port=37059
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:46545
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:15.499575 3141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:15.499841 3141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:15.499881 3141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:15.503971 3141 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:26:15.504033 3141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:15.504053 3141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:15.504070 3141 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:26:15.504086 3141 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:26:15.509445 3141 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:46545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:46545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=37059
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:15.510535 3141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:15.511548 3141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:15.519928 3147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:15.519944 3148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:15.519925 3151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:15.520306 3141 server_base.cc:1034] running on GCE node
I20260809 02:26:15.520888 3141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:15.521924 3141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:15.523094 3141 hybrid_clock.cc:648] HybridClock initialized: now 1786242375523051 us; error 52 us; skew 500 ppm
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242375, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:15.526116 3141 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:26:15.527029 3141 webserver.cc:460] Webserver started at http://127.21.214.190:37059/ using document root <none> and password file <none>
I20260809 02:26:15.527587 3141 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:15.527689 3141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:15.531502 3141 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 02:26:15.533576 3158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:15.534855 3141 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:26:15.534997 3141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "60dddb43c073459ba490786115bb3045"
format_stamp: "Formatted at 2026-08-09 02:26:14 on dist-test-slave-68xk"
server_key: "5f6fdf0e6c1c93fcf47817aaa5575ded"
server_key_iv: "11d64f9b22f8c66e29e6a85660ef17d8"
server_key_version: "encryptionkey@0"
I20260809 02:26:15.535530 3141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:15.555140 3141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:15.558110 3141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:15.558321 3141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:15.565681 3141 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:46545
I20260809 02:26:15.565711 3234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:46545 every 8 connection(s)
I20260809 02:26:15.566758 3141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:26:15.571167 3235 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:26:15.572808 3235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045: Bootstrap starting.
I20260809 02:26:15.575115 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 3141
I20260809 02:26:15.575587 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:44929
--local_ip_for_outbound_sockets=127.21.214.129
--tserver_master_addrs=127.21.214.190:46545
--webserver_port=32885
--webserver_interface=127.21.214.129
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.21.214.129
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:26:15.590829 3235 log.cc:824] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:15.597765 3235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:26:15.598222 3235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045: Bootstrap complete.
I20260809 02:26:15.602706 3235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60dddb43c073459ba490786115bb3045" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 46545 } }
I20260809 02:26:15.603159 3235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60dddb43c073459ba490786115bb3045, State: Initialized, Role: FOLLOWER
I20260809 02:26:15.603711 3235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60dddb43c073459ba490786115bb3045" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 46545 } }
I20260809 02:26:15.603861 3235 raft_consensus.cc:388] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:26:15.603955 3235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:26:15.604072 3235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:26:15.606091 3235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60dddb43c073459ba490786115bb3045" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 46545 } }
I20260809 02:26:15.606493 3235 leader_election.cc:302] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60dddb43c073459ba490786115bb3045; no voters:
I20260809 02:26:15.606884 3235 leader_election.cc:288] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:26:15.606980 3240 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:26:15.607192 3240 raft_consensus.cc:686] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [term 2 LEADER]: Becoming Leader. State: Replica: 60dddb43c073459ba490786115bb3045, State: Running, Role: LEADER
I20260809 02:26:15.607489 3240 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60dddb43c073459ba490786115bb3045" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 46545 } }
I20260809 02:26:15.608144 3235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:26:15.608883 3241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "60dddb43c073459ba490786115bb3045" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60dddb43c073459ba490786115bb3045" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 46545 } } }
I20260809 02:26:15.609011 3241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:15.609637 3242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60dddb43c073459ba490786115bb3045. Latest consensus state: current_term: 2 leader_uuid: "60dddb43c073459ba490786115bb3045" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60dddb43c073459ba490786115bb3045" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 46545 } } }
I20260809 02:26:15.609802 3242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045 [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:15.610061 3249 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:26:15.613528 3249 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:26:15.614171 3249 catalog_manager.cc:1259] Loaded cluster ID: 751b4bb00ac749f4a7cd75271326662b
I20260809 02:26:15.614233 3249 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:26:15.616623 3249 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:26:15.617286 3249 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 60dddb43c073459ba490786115bb3045: Loaded TSK: 0
I20260809 02:26:15.618521 3249 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:26:15.694114 3237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:15.694360 3237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:15.694404 3237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:15.698468 3237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:15.698525 3237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:15.698619 3237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:26:15.703912 3237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.129.keytab
--principal=oryx/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:44929
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=32885
--tserver_master_addrs=127.21.214.190:46545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:15.704962 3237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:15.706017 3237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:15.716130 3271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:15.716116 3268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:15.716116 3269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:15.716643 3237 server_base.cc:1034] running on GCE node
I20260809 02:26:15.717068 3237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:15.717746 3237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:15.718936 3237 hybrid_clock.cc:648] HybridClock initialized: now 1786242375718906 us; error 49 us; skew 500 ppm
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242375, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:15.721794 3237 init.cc:377] Logged in from keytab as oryx/127.21.214.129@KRBTEST.COM (short username oryx)
I20260809 02:26:15.722894 3237 webserver.cc:460] Webserver started at http://127.21.214.129:32885/ using document root <none> and password file <none>
I20260809 02:26:15.723485 3237 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:15.723562 3237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:15.727558 3237 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:26:15.729730 3280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:15.731052 3237 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:26:15.731177 3237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "94e2c341c375431291fc21ae3211e227"
format_stamp: "Formatted at 2026-08-09 02:26:14 on dist-test-slave-68xk"
server_key: "ec2cffd50fed9fe12ad5ae238f234da0"
server_key_iv: "7d855d13fdb3f6a01aa976b92f8f1a14"
server_key_version: "encryptionkey@0"
I20260809 02:26:15.731717 3237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:15.750698 3237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:15.753708 3237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:15.753919 3237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:15.754581 3237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:15.755434 3237 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:15.755482 3237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:15.755548 3237 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:15.755581 3237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:15.764689 3237 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:44929
I20260809 02:26:15.764734 3433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:44929 every 8 connection(s)
I20260809 02:26:15.765734 3237 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:26:15.773851 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 3237
I20260809 02:26:15.774348 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:33569
--local_ip_for_outbound_sockets=127.21.214.130
--tserver_master_addrs=127.21.214.190:46545
--webserver_port=36083
--webserver_interface=127.21.214.130
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.21.214.130
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:26:15.779524 3436 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:15.767856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:38717 (local address 127.21.214.190:46545)
0809 02:26:15.768375 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:15.768395 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:15.768665 (+ 270us) server_negotiation.cc:407] Connection header received
0809 02:26:15.770255 (+ 1590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:15.770266 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:15.770577 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:15.770841 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:15.772076 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.773042 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.774322 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.774919 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.775100 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.778789 (+ 3689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:38717: BlockingRecv error: recv got EOF from 127.21.214.129:38717 (error 108)
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":144,"threads_started":1}
I20260809 02:26:15.779551 3437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:15.767972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:38717)
0809 02:26:15.768491 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:15.768541 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:15.769809 (+ 1268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:15.770995 (+ 1186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:15.771002 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:15.771399 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:15.771907 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.771923 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.773198 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.773201 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.774183 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.774194 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.775106 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.775111 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.775302 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.775929 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:15.775945 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:15.778563 (+ 2618us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":151,"threads_started":1}
W20260809 02:26:15.780196 3434 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:46545 (0 consecutive failures): Not authorized: Failed to ping master at 127.21.214.190:46545: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:15.787051 3437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:15.780704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:51127)
0809 02:26:15.780912 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:15.780929 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:15.781026 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:15.781291 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:15.781296 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:15.781496 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:15.781642 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.781651 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.782446 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.782452 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.783467 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.783481 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.783946 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.783951 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.784079 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.784586 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:15.784603 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:15.786861 (+ 2258us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121}
W20260809 02:26:15.787132 3436 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:15.780793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:51127 (local address 127.21.214.190:46545)
0809 02:26:15.780908 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:15.780911 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:15.780977 (+ 66us) server_negotiation.cc:407] Connection header received
0809 02:26:15.781122 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:15.781124 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:15.781164 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:15.781236 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:15.781804 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.782304 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.783597 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.783824 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.783907 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.787005 (+ 3098us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:51127: BlockingRecv error: recv got EOF from 127.21.214.129:51127 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:15.792971 3437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:15.787792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:51591)
0809 02:26:15.788060 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:15.788074 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:15.788191 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:15.788453 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:15.788455 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:15.788619 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:15.788690 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.788695 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.789454 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.789459 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.789977 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.789985 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.790459 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.790462 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.790544 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.791033 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:15.791055 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:15.792819 (+ 1764us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201}
W20260809 02:26:15.793154 3436 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:15.787919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:51591 (local address 127.21.214.190:46545)
0809 02:26:15.788042 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:15.788046 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:15.788145 (+ 99us) server_negotiation.cc:407] Connection header received
0809 02:26:15.788300 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:15.788303 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:15.788352 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:15.788437 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:15.788802 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.789320 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.790098 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.790317 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.790425 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.792938 (+ 2513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:51591: BlockingRecv error: recv got EOF from 127.21.214.129:51591 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 02:26:15.793289 3434 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:26:15.893065 3438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:15.893332 3438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:15.893378 3438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:15.897428 3438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:15.897493 3438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:15.897552 3438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:26:15.902842 3438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.130.keytab
--principal=oryx/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:33569
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=36083
--tserver_master_addrs=127.21.214.190:46545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:15.903855 3438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:15.904851 3438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:15.915215 3449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:15.915261 3445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:15.915238 3447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:15.915519 3438 server_base.cc:1034] running on GCE node
I20260809 02:26:15.915946 3438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:15.916658 3438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:15.917857 3438 hybrid_clock.cc:648] HybridClock initialized: now 1786242375917842 us; error 28 us; skew 500 ppm
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242375, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:15.920840 3438 init.cc:377] Logged in from keytab as oryx/127.21.214.130@KRBTEST.COM (short username oryx)
I20260809 02:26:15.921710 3438 webserver.cc:460] Webserver started at http://127.21.214.130:36083/ using document root <none> and password file <none>
I20260809 02:26:15.922240 3438 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:15.922323 3438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:15.926165 3438 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 02:26:15.928319 3456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:15.929612 3438 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:26:15.929754 3438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "5dd6e2ea3ddd4193ba1f02e7049ede93"
format_stamp: "Formatted at 2026-08-09 02:26:14 on dist-test-slave-68xk"
server_key: "473919bfdf108d30ab89e24e6fd7c5d1"
server_key_iv: "f458e1d33118c9f58b04496c10621fae"
server_key_version: "encryptionkey@0"
I20260809 02:26:15.930341 3438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:15.947979 3438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:15.951500 3438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:15.951727 3438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:15.952379 3438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:15.953245 3438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:15.953303 3438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:15.953377 3438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:15.953413 3438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:15.963047 3438 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:33569
I20260809 02:26:15.963106 3618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:33569 every 8 connection(s)
I20260809 02:26:15.964124 3438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:26:15.972556 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 3438
I20260809 02:26:15.973062 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:36975
--local_ip_for_outbound_sockets=127.21.214.131
--tserver_master_addrs=127.21.214.190:46545
--webserver_port=38881
--webserver_interface=127.21.214.131
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.21.214.131
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:26:15.976433 3436 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:15.966104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:50221 (local address 127.21.214.190:46545)
0809 02:26:15.966253 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:15.966257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:15.967186 (+ 929us) server_negotiation.cc:407] Connection header received
0809 02:26:15.968610 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:15.968613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:15.968680 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:15.968788 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:15.970001 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.970685 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.971890 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.972100 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.972211 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.976328 (+ 4117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:50221: BlockingRecv error: recv got EOF from 127.21.214.130:50221 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 02:26:15.977316 3621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:15.966537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:50221)
0809 02:26:15.967016 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:15.967060 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:15.968386 (+ 1326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:15.968981 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:15.968988 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:15.969363 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:15.969846 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.969860 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.970833 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.970836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.971726 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.971736 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.972255 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.972259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.972432 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.973053 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:15.973070 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:15.976211 (+ 3141us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":113,"threads_started":1}
W20260809 02:26:15.977837 3619 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:46545 (0 consecutive failures): Not authorized: Failed to ping master at 127.21.214.190:46545: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:15.983651 3621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:15.978283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:43987)
0809 02:26:15.978517 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:15.978531 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:15.978611 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:15.978885 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:15.978888 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:15.979048 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:15.979139 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.979144 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.979935 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.979939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.980488 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.980496 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.980949 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.980952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.981052 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.981589 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:15.981600 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:15.983479 (+ 1879us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164}
W20260809 02:26:15.983685 3436 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:15.978445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:43987 (local address 127.21.214.190:46545)
0809 02:26:15.978561 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:15.978567 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:15.978582 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:26:15.978743 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:15.978746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:15.978784 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:15.978866 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:15.979322 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.979818 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.980611 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.980828 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.980936 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.983597 (+ 2661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:43987: BlockingRecv error: recv got EOF from 127.21.214.130:43987 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:15 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:15.990396 3621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:15.984369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:41761)
0809 02:26:15.984571 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:15.984588 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:15.984677 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:15.984948 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:15.984953 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:15.985171 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:15.985296 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.985307 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.986084 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.986090 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.987011 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:15.987022 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.987502 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.987505 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:15.987593 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.988076 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:15.988090 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:15.990179 (+ 2089us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118}
W20260809 02:26:15.990404 3436 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:15.984495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:41761 (local address 127.21.214.190:46545)
0809 02:26:15.984619 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:15.984623 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:15.984637 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:26:15.984779 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:15.984782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:15.984820 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:15.984895 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:15.985431 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.985960 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.987136 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:15.987376 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:15.987475 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:15.990321 (+ 2846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:41761: BlockingRecv error: recv got EOF from 127.21.214.130:41761 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 02:26:15.990676 3619 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:26:16.097750 3622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:16.098049 3622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:16.098124 3622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:16.102182 3622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:16.102270 3622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:16.102377 3622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:26:16.107668 3622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/krb5kdc/oryx_127.21.214.131.keytab
--principal=oryx/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:36975
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=38881
--tserver_master_addrs=127.21.214.190:46545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:16.108795 3622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:16.110044 3622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:16.120149 3632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:16.120191 3629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:16.120455 3622 server_base.cc:1034] running on GCE node
W20260809 02:26:16.120149 3630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:16.120903 3622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:16.121520 3622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:16.122682 3622 hybrid_clock.cc:648] HybridClock initialized: now 1786242376122670 us; error 27 us; skew 500 ppm
Aug 09 02:26:16 dist-test-slave-68xk krb5kdc[2419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242376, etypes {rep=17 tkt=17 ses=17}, oryx/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:16.125383 3622 init.cc:377] Logged in from keytab as oryx/127.21.214.131@KRBTEST.COM (short username oryx)
I20260809 02:26:16.126257 3622 webserver.cc:460] Webserver started at http://127.21.214.131:38881/ using document root <none> and password file <none>
I20260809 02:26:16.126878 3622 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:16.126988 3622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:16.130792 3622 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 02:26:16.132859 3643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:16.134150 3622 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:26:16.134284 3622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "18504ed6abe24177b878562394fea58b"
format_stamp: "Formatted at 2026-08-09 02:26:15 on dist-test-slave-68xk"
server_key: "a65bb6c6a5e8c57d0c05ccfeba008bc6"
server_key_iv: "6f8a65ced3155096e035b76af2f52b8a"
server_key_version: "encryptionkey@0"
I20260809 02:26:16.134917 3622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:16.150490 3622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:16.153173 3622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:16.153319 3622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:16.153820 3622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:16.154637 3622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:16.154690 3622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:16.154729 3622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:16.154745 3622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:16.164302 3622 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:36975
I20260809 02:26:16.164345 3809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:36975 every 8 connection(s)
I20260809 02:26:16.165272 3622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:26:16.171795 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 3622
Aug 09 02:26:16 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:16 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 02:26:16.177172 3436 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:16.166983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:35107 (local address 127.21.214.190:46545)
0809 02:26:16.167122 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:16.167126 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:16.167885 (+ 759us) server_negotiation.cc:407] Connection header received
0809 02:26:16.169255 (+ 1370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:16.169259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:16.169322 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:16.169426 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:16.170588 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.171288 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.172912 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.173243 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.173341 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:16.177068 (+ 3727us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:35107: BlockingRecv error: recv got EOF from 127.21.214.131:35107 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:26:16.177942 3812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:16.167287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:35107)
0809 02:26:16.167731 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:16.167772 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:16.169029 (+ 1257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:16.169606 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:16.169612 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:16.169949 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:16.170431 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:16.170447 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.171420 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.171428 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:16.172760 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:16.172772 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.173404 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.173409 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:16.173633 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:16.174224 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:16.174250 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:16.176968 (+ 2718us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":114,"threads_started":1}
W20260809 02:26:16.178462 3810 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:46545 (0 consecutive failures): Not authorized: Failed to ping master at 127.21.214.190:46545: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
I20260809 02:26:16.182806 3816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:16.172874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36722 (local address 127.21.214.190:46545)
0809 02:26:16.173108 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:16.173112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:16.173124 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:26:16.173156 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:16.173159 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:16.173201 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:16.173307 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:16.174307 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.174891 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.175817 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.176135 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.176217 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:16.177779 (+ 1562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:16.177785 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:16.177799 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:16.177825 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:16.180508 (+ 2683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:16.181003 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:16.181008 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:16.181011 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:16.181130 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:16.181417 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:16.181419 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:16.181420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:16.181869 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:16.182049 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:16.182429 (+ 380us) server_negotiation.cc:299] Negotiation successful
0809 02:26:16.182690 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":74,"threads_started":1}
Aug 09 02:26:16 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:16 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:16.184551 3812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:16.178887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:56583)
0809 02:26:16.178993 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:16.179008 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:16.179082 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:16.179341 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:16.179345 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:16.179522 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:16.179623 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:16.179628 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.180618 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.180621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:16.181379 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:16.181391 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.181949 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.181956 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:16.182047 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:16.182507 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:16.182523 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:16.184445 (+ 1922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 02:26:16.184751 3436 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:16.178984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:56583 (local address 127.21.214.190:46545)
0809 02:26:16.179092 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:16.179097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:16.179114 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:26:16.179151 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:16.179155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:16.179203 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:16.179292 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:16.179757 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.180494 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.181490 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.181811 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.181925 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:16.184621 (+ 2696us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:56583: BlockingRecv error: recv got EOF from 127.21.214.131:56583 (error 108)
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":43}
Aug 09 02:26:16 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:16 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:16.190117 3812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:16.185230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:60311)
0809 02:26:16.185659 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:16.185671 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:16.185775 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:16.186017 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:16.186020 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:16.186168 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:16.186234 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:16.186239 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.187002 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.187006 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:16.187546 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:16.187554 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.188018 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.188021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:16.188108 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:16.188467 (+ 359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:16.188478 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:16.190037 (+ 1559us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":372}
W20260809 02:26:16.190294 3436 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:16.185304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:60311 (local address 127.21.214.190:46545)
0809 02:26:16.185440 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:16.185443 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:16.185739 (+ 296us) server_negotiation.cc:407] Connection header received
0809 02:26:16.185874 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:16.185876 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:16.185914 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:16.186003 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:16.186354 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.186893 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.187672 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.187900 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.188005 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:16.190170 (+ 2165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:60311: BlockingRecv error: recv got EOF from 127.21.214.131:60311 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 02:26:16.190354 3810 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 02:26:16 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:16 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:16.799937 3817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:16.793996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:50429)
0809 02:26:16.794317 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:16.794331 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:16.794446 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:16.794756 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:16.794758 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:16.794953 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:16.795070 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:16.795076 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.795913 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.795915 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:16.796512 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:16.796520 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.797008 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.797010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:16.797089 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:16.797707 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:16.797720 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:16.799809 (+ 2089us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":94,"threads_started":1}
W20260809 02:26:16.800144 3818 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:16.794099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:50429 (local address 127.21.214.190:46545)
0809 02:26:16.794506 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:16.794510 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:16.794529 (+ 19us) server_negotiation.cc:407] Connection header received
0809 02:26:16.794567 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:16.794569 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:16.794613 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:16.794717 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:16.795219 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.795810 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.796664 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.796902 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.796991 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:16.799975 (+ 2984us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:50429: BlockingRecv error: recv got EOF from 127.21.214.129:50429 (error 108)
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":182,"threads_started":1}
Aug 09 02:26:16 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:16 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:16.997608 3819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:16.991348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:33873)
0809 02:26:16.991715 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:16.991730 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:16.991888 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:16.992167 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:16.992169 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:16.992424 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:16.992525 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:16.992530 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.993317 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.993323 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:16.993900 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:16.993907 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.994380 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.994384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:16.994523 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:16.995083 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:16.995095 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:16.997420 (+ 2325us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":118,"threads_started":1}
W20260809 02:26:16.997872 3818 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:16.991489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:33873 (local address 127.21.214.190:46545)
0809 02:26:16.991680 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:16.991685 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:16.991822 (+ 137us) server_negotiation.cc:407] Connection header received
0809 02:26:16.991993 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:16.991997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:16.992049 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:16.992139 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:16.992654 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.993201 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.994024 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:16.994251 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:16.994361 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:16.997591 (+ 3230us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:33873: BlockingRecv error: recv got EOF from 127.21.214.130:33873 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 09 02:26:17 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:17 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:17.197232 3821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:17.190997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:46207)
0809 02:26:17.191356 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:17.191371 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:17.191476 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:17.191772 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:17.191775 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:17.191977 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:17.192088 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:17.192093 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:17.192928 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:17.192931 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:17.193602 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:17.193611 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:17.194085 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:17.194088 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:17.194192 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:17.194777 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:17.194790 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:17.197062 (+ 2272us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":126,"threads_started":1}
W20260809 02:26:17.197521 3818 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:17.191113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:46207 (local address 127.21.214.190:46545)
0809 02:26:17.191271 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:17.191275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:17.191446 (+ 171us) server_negotiation.cc:407] Connection header received
0809 02:26:17.191562 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:17.191564 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:17.191628 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:17.191707 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:17.192232 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:17.192810 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:17.193732 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:17.193970 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:17.194059 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:17.197272 (+ 3213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:46207: BlockingRecv error: recv got EOF from 127.21.214.131:46207 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 02:26:17 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:17 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:17.806653 3822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:17.800831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:50661)
0809 02:26:17.801113 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:17.801127 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:17.801219 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:17.801454 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:17.801456 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:17.801646 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:17.801766 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:17.801772 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:17.802533 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:17.802536 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:17.803119 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:17.803127 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:17.803564 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:17.803566 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:17.803627 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:17.804129 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:17.804141 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:17.806529 (+ 2388us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":90,"threads_started":1}
W20260809 02:26:17.806905 3824 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:17.800930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:50661 (local address 127.21.214.190:46545)
0809 02:26:17.801213 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:17.801217 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:17.801232 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:26:17.801295 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:17.801297 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:17.801338 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:17.801412 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:17.801876 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:17.802445 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:17.803240 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:17.803465 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:17.803546 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:17.806756 (+ 3210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:50661: BlockingRecv error: recv got EOF from 127.21.214.129:50661 (error 108)
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":119,"threads_started":1}
Aug 09 02:26:18 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:18 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:18.004464 3825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:17.998471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:49071)
0809 02:26:17.998756 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:17.998770 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:17.998873 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:17.999117 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:17.999119 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:17.999315 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:17.999415 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:17.999421 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:18.000232 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:18.000235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:18.000823 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:18.000832 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:18.001264 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:18.001267 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:18.001341 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:18.001845 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:18.001856 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:18.004226 (+ 2370us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":93,"threads_started":1}
W20260809 02:26:18.004506 3824 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:17.998559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:49071 (local address 127.21.214.190:46545)
0809 02:26:17.998713 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:17.998717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:17.998841 (+ 124us) server_negotiation.cc:407] Connection header received
0809 02:26:17.998955 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:17.998957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:17.999002 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:17.999075 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:17.999526 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:18.000088 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:18.000934 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:18.001150 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:18.001231 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:18.004385 (+ 3154us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:49071: BlockingRecv error: recv got EOF from 127.21.214.130:49071 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 02:26:18 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:18 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:18.204030 3827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:18.198049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:38497)
0809 02:26:18.198343 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:18.198360 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:18.198527 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:18.198840 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:18.198843 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:18.199053 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:18.199153 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:18.199159 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:18.200135 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:18.200140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:18.200851 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:18.200862 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:18.201333 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:18.201337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:18.201422 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:18.201905 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:18.201916 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:18.203880 (+ 1964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":89,"threads_started":1}
W20260809 02:26:18.204164 3824 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:18.198279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:38497 (local address 127.21.214.190:46545)
0809 02:26:18.198441 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:18.198447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:18.198463 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:26:18.198641 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:18.198643 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:18.198701 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:18.198811 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:18.199310 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:18.200024 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:18.200972 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:18.201208 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:18.201318 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:18.204019 (+ 2701us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:38497: BlockingRecv error: recv got EOF from 127.21.214.131:38497 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 09 02:26:18 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:18 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:18.813452 3829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:18.807432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:56141)
0809 02:26:18.807715 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:18.807748 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:18.807841 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:18.808131 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:18.808133 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:18.808345 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:18.808451 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:18.808457 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:18.809372 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:18.809375 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:18.810099 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:18.810110 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:18.810682 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:18.810686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:18.810794 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:18.811347 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:18.811359 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:18.813333 (+ 1974us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":102,"threads_started":1}
W20260809 02:26:18.813640 3830 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:18.807534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:56141 (local address 127.21.214.190:46545)
0809 02:26:18.807798 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:18.807802 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:18.807816 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:26:18.807954 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:18.807960 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:18.808019 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:18.808099 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:18.808565 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:18.809236 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:18.810258 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:18.810541 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:18.810654 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:18.813485 (+ 2831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:56141: BlockingRecv error: recv got EOF from 127.21.214.129:56141 (error 108)
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":93,"threads_started":1}
Aug 09 02:26:19 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:19 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:19.012221 3831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:19.005512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:43009)
0809 02:26:19.005945 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:19.005966 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:19.006132 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:19.006532 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:19.006535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:19.006799 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:19.006937 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:19.006944 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:19.007717 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:19.007722 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:19.008392 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:19.008401 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:19.008965 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:19.008969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:19.009053 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:19.009699 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:19.009721 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:19.012030 (+ 2309us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":95,"threads_started":1}
W20260809 02:26:19.012349 3830 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:19.005634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:43009 (local address 127.21.214.190:46545)
0809 02:26:19.005778 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:19.005784 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:19.006243 (+ 459us) server_negotiation.cc:407] Connection header received
0809 02:26:19.006296 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:19.006301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:19.006367 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:19.006506 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:19.007059 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:19.007604 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:19.008514 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:19.008864 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:19.008960 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:19.012211 (+ 3251us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:43009: BlockingRecv error: recv got EOF from 127.21.214.130:43009 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 09 02:26:19 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:19 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:19.215616 3832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:19.204823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:59475)
0809 02:26:19.205153 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:19.205170 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:19.205282 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:19.205530 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:19.205533 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:19.205747 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:19.205851 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:19.205856 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:19.206615 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:19.206619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:19.207207 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:19.207216 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:19.207627 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:19.207630 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:19.207711 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:19.213172 (+ 5461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:19.213185 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:19.215496 (+ 2311us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":134,"threads_started":1}
W20260809 02:26:19.215818 3830 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:19.204880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:59475 (local address 127.21.214.190:46545)
0809 02:26:19.205018 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:19.205021 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:19.205247 (+ 226us) server_negotiation.cc:407] Connection header received
0809 02:26:19.205364 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:19.205366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:19.205413 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:19.205483 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:19.205965 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:19.206513 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:19.207311 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:19.207519 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:19.207593 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:19.215681 (+ 8088us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:59475: BlockingRecv error: recv got EOF from 127.21.214.131:59475 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 02:26:19 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:19 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:19.825419 3834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:19.814919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:37841)
0809 02:26:19.815718 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:19.815744 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:19.815926 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:19.816399 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:19.816401 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:19.816686 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:19.817036 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:19.817043 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:19.818288 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:19.818299 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:19.819544 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:19.819556 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:19.820490 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:19.820495 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:19.820671 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:19.821572 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:19.821589 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:19.825014 (+ 3425us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":419,"threads_started":1}
W20260809 02:26:19.825551 3836 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:19.815249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:37841 (local address 127.21.214.190:46545)
0809 02:26:19.815721 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:19.815735 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:19.815844 (+ 109us) server_negotiation.cc:407] Connection header received
0809 02:26:19.816153 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:19.816155 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:19.816215 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:19.816352 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:19.817180 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:19.818111 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:19.819685 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:19.820253 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:19.820472 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:19.825251 (+ 4779us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:37841: BlockingRecv error: recv got EOF from 127.21.214.129:37841 (error 108)
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":129,"threads_started":1}
Aug 09 02:26:20 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:20 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:20.035254 3837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:20.013645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:47411)
0809 02:26:20.014177 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:20.014199 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:20.014382 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:20.015028 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:20.015031 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:20.015512 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:20.015873 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:20.015898 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:20.017672 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:20.017676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:20.019484 (+ 1808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:20.019496 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:20.020888 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:20.020893 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:20.021045 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:20.022167 (+ 1122us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:20.022209 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:20.034808 (+ 12599us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":130,"threads_started":1}
W20260809 02:26:20.035789 3836 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:20.013800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:47411 (local address 127.21.214.190:46545)
0809 02:26:20.014044 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:20.014051 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:20.014293 (+ 242us) server_negotiation.cc:407] Connection header received
0809 02:26:20.014594 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:20.014612 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:20.014838 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:20.015013 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:20.016107 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:20.017447 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:20.019868 (+ 2421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:20.020675 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:20.020885 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:20.035212 (+ 14327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:47411: BlockingRecv error: recv got EOF from 127.21.214.130:47411 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 09 02:26:20 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:20 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:20.227293 3838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:20.216799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:49459)
0809 02:26:20.217289 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:20.217304 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:20.217632 (+ 328us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:20.218120 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:20.218122 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:20.218614 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:20.218788 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:20.218796 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:20.220193 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:20.220197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:20.221127 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:20.221137 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:20.221959 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:20.221962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:20.222063 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:20.223058 (+ 995us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:20.223074 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:20.227105 (+ 4031us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":176,"threads_started":1}
W20260809 02:26:20.227538 3836 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:20.216857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:49459 (local address 127.21.214.190:46545)
0809 02:26:20.217112 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:20.217121 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:20.217415 (+ 294us) server_negotiation.cc:407] Connection header received
0809 02:26:20.217851 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:20.217867 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:20.217942 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:20.218093 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:20.219162 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:20.220041 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:20.221417 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:20.221792 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:20.221938 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:20.227304 (+ 5366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:49459: BlockingRecv error: recv got EOF from 127.21.214.131:49459 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 09 02:26:20 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:20 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:20.842718 3840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:20.830635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:41883)
0809 02:26:20.831972 (+ 1337us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:20.831997 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:20.832156 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:20.832535 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:20.832537 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:20.832860 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:20.833192 (+ 332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:20.833208 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:20.834804 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:20.834808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:20.835944 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:20.835961 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:20.837049 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:20.837060 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:20.837228 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:20.838377 (+ 1149us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:20.838398 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:20.842315 (+ 3917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1103,"thread_start_us":746,"threads_started":1}
W20260809 02:26:20.842779 3841 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:20.831355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:41883 (local address 127.21.214.190:46545)
0809 02:26:20.832183 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:20.832194 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:20.832223 (+ 29us) server_negotiation.cc:407] Connection header received
0809 02:26:20.832327 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:20.832329 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:20.832396 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:20.832517 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:20.833467 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:20.834672 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:20.836131 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:20.836728 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:20.837026 (+ 298us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:20.842628 (+ 5602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:41883: BlockingRecv error: recv got EOF from 127.21.214.129:41883 (error 108)
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":246,"threads_started":1}
Aug 09 02:26:21 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:21 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:21.048121 3842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:21.037050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:34803)
0809 02:26:21.037689 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:21.037736 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:21.038039 (+ 303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:21.039195 (+ 1156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:21.039205 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:21.039725 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:21.039906 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:21.039916 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:21.041771 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:21.041778 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:21.042582 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:21.042597 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:21.043428 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:21.043432 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:21.043550 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:21.044482 (+ 932us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:21.044526 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:21.047774 (+ 3248us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":187,"threads_started":1}
W20260809 02:26:21.048259 3841 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:21.038068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:34803 (local address 127.21.214.190:46545)
0809 02:26:21.038543 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:21.038562 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:21.038585 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:26:21.038689 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:21.038704 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:21.038884 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:21.039131 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:21.040146 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:21.041594 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:21.042801 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:21.043231 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:21.043425 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:21.048013 (+ 4588us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:34803: BlockingRecv error: recv got EOF from 127.21.214.130:34803 (error 108)
Metrics: {"server-negotiator.queue_time_us":248}
Aug 09 02:26:21 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:21 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:21.240365 3843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:21.228836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:44949)
0809 02:26:21.229194 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:21.229215 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:21.229360 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:21.229739 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:21.229741 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:21.230030 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:21.230204 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:21.230216 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:21.232245 (+ 2029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:21.232251 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:21.233370 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:21.233390 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:21.234150 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:21.234155 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:21.234272 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:21.235441 (+ 1169us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:21.235466 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:21.240185 (+ 4719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":139,"threads_started":1}
W20260809 02:26:21.240646 3841 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:21.228989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:44949 (local address 127.21.214.190:46545)
0809 02:26:21.229181 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:21.229186 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:21.229312 (+ 126us) server_negotiation.cc:407] Connection header received
0809 02:26:21.229479 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:21.229481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:21.229571 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:21.229715 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:21.230362 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:21.231847 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:21.233538 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:21.233994 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:21.234182 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:21.240400 (+ 6218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:44949: BlockingRecv error: recv got EOF from 127.21.214.131:44949 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 02:26:21 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:21 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:21.851387 3846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:21.844005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:40711)
0809 02:26:21.844759 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:21.844789 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:21.844989 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:21.845439 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:21.845442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:21.845782 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:21.845934 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:21.845942 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:21.847107 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:21.847111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:21.847723 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:21.847734 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:21.848279 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:21.848282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:21.848364 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:21.848964 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:21.848976 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:21.851153 (+ 2177us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":178,"threads_started":1}
W20260809 02:26:21.851660 3844 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:21.844053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:40711 (local address 127.21.214.190:46545)
0809 02:26:21.844772 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:21.844785 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:21.844932 (+ 147us) server_negotiation.cc:407] Connection header received
0809 02:26:21.845137 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:21.845141 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:21.845222 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:21.845354 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:21.846071 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:21.846956 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:21.847862 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:21.848108 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:21.848217 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:21.851393 (+ 3176us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:40711: BlockingRecv error: recv got EOF from 127.21.214.129:40711 (error 108)
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":89,"threads_started":1}
Aug 09 02:26:22 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:22 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:22.058286 3848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:22.049713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:47875)
0809 02:26:22.050345 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:22.050369 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:22.050572 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:22.050972 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:22.050975 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:22.051431 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:22.051714 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:22.051731 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:22.053185 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:22.053190 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:22.054192 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:22.054202 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:22.054698 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:22.054702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:22.054799 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:22.055440 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:22.055453 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:22.058094 (+ 2641us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":363,"threads_started":1}
W20260809 02:26:22.058383 3844 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:22.049787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:47875 (local address 127.21.214.190:46545)
0809 02:26:22.050211 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:22.050216 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:22.050497 (+ 281us) server_negotiation.cc:407] Connection header received
0809 02:26:22.050691 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:22.050693 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:22.050786 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:22.050903 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:22.051962 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:22.052972 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:22.054323 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:22.054574 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:22.054690 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:22.058237 (+ 3547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:47875: BlockingRecv error: recv got EOF from 127.21.214.130:47875 (error 108)
Metrics: {"server-negotiator.queue_time_us":138}
Aug 09 02:26:22 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:22 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:22.249768 3849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:22.242061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:45505)
0809 02:26:22.242560 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:22.242585 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:22.242727 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:22.243159 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:22.243171 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:22.243639 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:22.243800 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:22.243806 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:22.244716 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:22.244721 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:22.245557 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:22.245569 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:22.246130 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:22.246133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:22.246249 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:22.246831 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:22.246843 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:22.249587 (+ 2744us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":150,"threads_started":1}
W20260809 02:26:22.249908 3844 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:22.242201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:45505 (local address 127.21.214.190:46545)
0809 02:26:22.242553 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:22.242587 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:22.242685 (+ 98us) server_negotiation.cc:407] Connection header received
0809 02:26:22.242866 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:22.242871 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:22.242974 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:22.243112 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:22.243937 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:22.244603 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:22.245693 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:22.246001 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:22.246114 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:22.249767 (+ 3653us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:45505: BlockingRecv error: recv got EOF from 127.21.214.131:45505 (error 108)
Metrics: {"server-negotiator.queue_time_us":112}
Aug 09 02:26:22 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:22 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:22.858393 3851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:22.852501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:40439)
0809 02:26:22.852983 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:22.852997 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:22.853098 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:22.853392 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:22.853395 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:22.853614 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:22.853739 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:22.853745 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:22.854602 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:22.854605 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:22.855209 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:22.855218 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:22.855677 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:22.855680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:22.855750 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:22.856256 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:22.856268 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:22.858271 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":102,"threads_started":1}
W20260809 02:26:22.858600 3850 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:22.852567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:40439 (local address 127.21.214.190:46545)
0809 02:26:22.852883 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:22.852887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:22.853070 (+ 183us) server_negotiation.cc:407] Connection header received
0809 02:26:22.853184 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:22.853186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:22.853230 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:22.853310 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:22.853877 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:22.854489 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:22.855329 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:22.855556 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:22.855640 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:22.858455 (+ 2815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:40439: BlockingRecv error: recv got EOF from 127.21.214.129:40439 (error 108)
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":121,"threads_started":1}
Aug 09 02:26:23 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:23 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:23.065804 3853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:23.059253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:43989)
0809 02:26:23.059742 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:23.059755 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:23.059864 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:23.060094 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:23.060096 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:23.060326 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:23.060456 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:23.060462 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:23.061655 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:23.061659 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:23.062357 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:23.062368 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:23.062872 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:23.062874 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:23.062938 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:23.063440 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:23.063451 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:23.065600 (+ 2149us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":139,"threads_started":1}
W20260809 02:26:23.065836 3850 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:23.059308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:43989 (local address 127.21.214.190:46545)
0809 02:26:23.059479 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:23.059483 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:23.059851 (+ 368us) server_negotiation.cc:407] Connection header received
0809 02:26:23.059934 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:23.059936 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:23.059986 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:23.060058 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:23.060597 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:23.061414 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:23.062533 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:23.062760 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:23.062854 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:23.065733 (+ 2879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:43989: BlockingRecv error: recv got EOF from 127.21.214.130:43989 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 09 02:26:23 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:23 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:23.256894 3855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:23.250719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:32947)
0809 02:26:23.251155 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:23.251171 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:23.251279 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:23.251536 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:23.251538 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:23.251746 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:23.251849 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:23.251855 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:23.252574 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:23.252576 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:23.253150 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:23.253160 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:23.253610 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:23.253613 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:23.253688 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:23.254332 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:23.254345 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:23.256723 (+ 2378us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":98,"threads_started":1}
W20260809 02:26:23.257055 3850 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:23.250798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:32947 (local address 127.21.214.190:46545)
0809 02:26:23.250968 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:23.250974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:23.251263 (+ 289us) server_negotiation.cc:407] Connection header received
0809 02:26:23.251364 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:23.251366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:23.251416 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:23.251488 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:23.251953 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:23.252473 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:23.253257 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:23.253468 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:23.253546 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:23.256911 (+ 3365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:32947: BlockingRecv error: recv got EOF from 127.21.214.131:32947 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 09 02:26:23 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:23 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:23.865608 3857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:23.859398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:47665)
0809 02:26:23.859698 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:23.859713 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:23.859806 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:23.860053 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:23.860055 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:23.860263 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:23.860365 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:23.860370 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:23.861296 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:23.861301 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:23.862117 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:23.862171 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:23.862771 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:23.862774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:23.862843 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:23.863418 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:23.863429 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:23.865427 (+ 1998us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":102,"threads_started":1}
W20260809 02:26:23.865691 3858 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:23.859581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:47665 (local address 127.21.214.190:46545)
0809 02:26:23.859823 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:23.859826 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:23.859839 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:26:23.859880 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:23.859882 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:23.859924 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:23.860011 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:23.860493 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:23.861124 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:23.862302 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:23.862660 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:23.862747 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:23.865554 (+ 2807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:47665: BlockingRecv error: recv got EOF from 127.21.214.129:47665 (error 108)
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":95,"threads_started":1}
Aug 09 02:26:24 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:24 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:24.073299 3861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:24.066595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:36759)
0809 02:26:24.066870 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:24.066885 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:24.066998 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:24.067379 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:24.067381 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:24.067564 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:24.067676 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:24.067681 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:24.068604 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:24.068607 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:24.069177 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:24.069186 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:24.069668 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:24.069670 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:24.069734 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:24.070513 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:24.070525 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:24.073114 (+ 2589us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":97,"threads_started":1}
W20260809 02:26:24.073369 3858 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:24.066726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:36759 (local address 127.21.214.190:46545)
0809 02:26:24.066884 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:24.066888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:24.066966 (+ 78us) server_negotiation.cc:407] Connection header received
0809 02:26:24.067206 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:24.067209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:24.067260 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:24.067337 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:24.067789 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:24.068496 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:24.069303 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:24.069543 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:24.069636 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:24.073257 (+ 3621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:36759: BlockingRecv error: recv got EOF from 127.21.214.130:36759 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 02:26:24 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:24 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:24.266072 3862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:24.257862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:40661)
0809 02:26:24.258143 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:24.258157 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:24.258342 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:24.258719 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:24.258722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:24.258954 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:24.259064 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:24.259071 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:24.260171 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:24.260178 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:24.261492 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:24.261505 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:24.262066 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:24.262070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:24.262171 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:24.262843 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:24.262860 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:24.265894 (+ 3034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":87,"threads_started":1}
W20260809 02:26:24.266300 3858 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:24.257899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:40661 (local address 127.21.214.190:46545)
0809 02:26:24.258044 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:24.258049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:24.258275 (+ 226us) server_negotiation.cc:407] Connection header received
0809 02:26:24.258474 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:24.258481 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:24.258550 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:24.258691 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:24.259198 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:24.260023 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:24.261660 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:24.261926 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:24.262053 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:24.266161 (+ 4108us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:40661: BlockingRecv error: recv got EOF from 127.21.214.131:40661 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 02:26:24 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:24 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:24.873044 3863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:24.866564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:50639)
0809 02:26:24.866871 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:24.866892 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:24.867011 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:24.867243 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:24.867245 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:24.867448 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:24.867554 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:24.867560 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:24.868353 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:24.868355 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:24.868985 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:24.868993 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:24.869463 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:24.869466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:24.869537 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:24.870241 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:24.870258 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:24.872867 (+ 2609us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":83,"threads_started":1}
W20260809 02:26:24.873145 3865 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:24.866730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:50639 (local address 127.21.214.190:46545)
0809 02:26:24.867004 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:24.867008 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:24.867023 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:26:24.867083 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:24.867085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:24.867128 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:24.867204 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:24.867685 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:24.868215 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:24.869102 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:24.869352 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:24.869432 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:24.873009 (+ 3577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:50639: BlockingRecv error: recv got EOF from 127.21.214.129:50639 (error 108)
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":94,"threads_started":1}
Aug 09 02:26:25 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:25 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:25.079912 3868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:25.074230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:41633)
0809 02:26:25.074642 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:25.074657 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:25.074755 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:25.075029 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:25.075032 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:25.075249 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:25.075352 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:25.075358 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:25.076090 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:25.076094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:25.076670 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:25.076678 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:25.077102 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:25.077104 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:25.077165 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:25.077685 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:25.077697 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:25.079776 (+ 2079us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":91,"threads_started":1}
W20260809 02:26:25.080047 3865 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:25.074357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:41633 (local address 127.21.214.190:46545)
0809 02:26:25.074516 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:25.074522 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:25.074731 (+ 209us) server_negotiation.cc:407] Connection header received
0809 02:26:25.074834 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:25.074836 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:25.074882 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:25.074953 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:25.075462 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:25.075987 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:25.076783 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:25.077001 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:25.077080 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:25.079924 (+ 2844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:41633: BlockingRecv error: recv got EOF from 127.21.214.130:41633 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 02:26:25 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:25 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:25.273895 3869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:25.267156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:35733)
0809 02:26:25.267507 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:25.267520 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:25.267682 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:25.267980 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:25.267983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:25.268201 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:25.268302 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:25.268308 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:25.269062 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:25.269067 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:25.269636 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:25.269644 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:25.270110 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:25.270114 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:25.270200 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:25.270936 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:25.270948 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:25.273702 (+ 2754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":137,"threads_started":1}
W20260809 02:26:25.273941 3865 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:25.267227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:35733 (local address 127.21.214.190:46545)
0809 02:26:25.267385 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:25.267390 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:25.267617 (+ 227us) server_negotiation.cc:407] Connection header received
0809 02:26:25.267809 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:25.267814 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:25.267866 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:25.267952 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:25.268418 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:25.268951 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:25.269764 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:25.269989 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:25.270100 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:25.273836 (+ 3736us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:35733: BlockingRecv error: recv got EOF from 127.21.214.131:35733 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 02:26:25 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:25 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:25.880290 3870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:25.874018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:57451)
0809 02:26:25.874331 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:25.874348 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:25.874506 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:25.874806 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:25.874808 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:25.875016 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:25.875132 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:25.875138 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:25.875975 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:25.875979 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:25.876546 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:25.876555 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:25.877047 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:25.877052 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:25.877140 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:25.877669 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:25.877682 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:25.880128 (+ 2446us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":108,"threads_started":1}
W20260809 02:26:25.880545 3872 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:25.874124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:57451 (local address 127.21.214.190:46545)
0809 02:26:25.874393 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:25.874396 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:25.874428 (+ 32us) server_negotiation.cc:407] Connection header received
0809 02:26:25.874617 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:25.874619 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:25.874667 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:25.874753 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:25.875272 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:25.875808 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:25.876675 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:25.876898 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:25.876980 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:25.880387 (+ 3407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:57451: BlockingRecv error: recv got EOF from 127.21.214.129:57451 (error 108)
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":115,"threads_started":1}
Aug 09 02:26:26 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:26 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:26.086521 3873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:26.080815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:39169)
0809 02:26:26.081118 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:26.081133 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:26.081272 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:26.081528 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:26.081531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:26.081740 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:26.081847 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:26.081853 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:26.082710 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:26.082713 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:26.083382 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:26.083392 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:26.083828 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:26.083831 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:26.083901 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:26.084391 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:26.084403 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:26.086373 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":77,"threads_started":1}
W20260809 02:26:26.086699 3872 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:26.080984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:39169 (local address 127.21.214.190:46545)
0809 02:26:26.081145 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:26.081148 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:26.081214 (+ 66us) server_negotiation.cc:407] Connection header received
0809 02:26:26.081367 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:26.081369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:26.081414 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:26.081483 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:26.081958 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:26.082604 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:26.083497 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:26.083721 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:26.083798 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:26.086565 (+ 2767us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:39169: BlockingRecv error: recv got EOF from 127.21.214.130:39169 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 09 02:26:26 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:26 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:26.280879 3875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:26.275242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:39983)
0809 02:26:26.275540 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:26.275554 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:26.275648 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:26.275934 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:26.275936 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:26.276173 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:26.276280 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:26.276286 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:26.277028 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:26.277031 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:26.277604 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:26.277612 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:26.278058 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:26.278061 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:26.278125 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:26.278789 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:26.278801 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:26.280760 (+ 1959us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":110,"threads_started":1}
W20260809 02:26:26.281015 3872 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:26.275386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:39983 (local address 127.21.214.190:46545)
0809 02:26:26.275536 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:26.275540 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:26.275609 (+ 69us) server_negotiation.cc:407] Connection header received
0809 02:26:26.275735 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:26.275737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:26.275811 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:26.275900 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:26.276402 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:26.276931 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:26.277723 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:26.277948 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:26.278028 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:26.280892 (+ 2864us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:39983: BlockingRecv error: recv got EOF from 127.21.214.131:39983 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 02:26:26 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:26 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:26.886775 3877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:26.881174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:50679)
0809 02:26:26.881491 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:26.881505 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:26.881598 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:26.881899 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:26.881901 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:26.882102 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:26.882216 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:26.882221 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:26.883018 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:26.883020 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:26.883579 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:26.883587 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:26.884054 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:26.884057 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:26.884150 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:26.884670 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:26.884682 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:26.886652 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":95,"threads_started":1}
W20260809 02:26:26.886950 3879 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:26.881286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:50679 (local address 127.21.214.190:46545)
0809 02:26:26.881529 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:26.881533 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:26.881548 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:26:26.881693 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:26.881695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:26.881742 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:26.881821 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:26.882333 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:26.882899 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:26.883688 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:26.883918 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:26.883999 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:26.886807 (+ 2808us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:50679: BlockingRecv error: recv got EOF from 127.21.214.129:50679 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":66,"threads_started":1}
Aug 09 02:26:27 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:27 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:27.093595 3880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:27.087521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:37495)
0809 02:26:27.087894 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:27.087907 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:27.088058 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:27.088407 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:27.088410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:27.088691 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:27.088844 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:27.088852 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:27.089728 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:27.089730 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:27.090303 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:27.090311 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:27.090762 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:27.090765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:27.090841 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:27.091434 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:27.091445 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:27.093476 (+ 2031us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":176,"threads_started":1}
W20260809 02:26:27.093744 3879 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:27.087640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:37495 (local address 127.21.214.190:46545)
0809 02:26:27.087802 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:27.087807 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:27.088017 (+ 210us) server_negotiation.cc:407] Connection header received
0809 02:26:27.088188 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:27.088194 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:27.088254 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:27.088363 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:27.088968 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:27.089618 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:27.090429 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:27.090641 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:27.090717 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:27.093621 (+ 2904us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:37495: BlockingRecv error: recv got EOF from 127.21.214.130:37495 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 02:26:27 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:27 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:27.287889 3881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:27.281828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:59247)
0809 02:26:27.282135 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:27.282152 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:27.282281 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:27.282563 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:27.282565 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:27.282799 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:27.282909 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:27.282915 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:27.283701 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:27.283704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:27.284437 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:27.284448 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:27.285099 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:27.285104 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:27.285204 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:27.285841 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:27.285854 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:27.287772 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":107,"threads_started":1}
W20260809 02:26:27.288070 3879 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:27.281946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:59247 (local address 127.21.214.190:46545)
0809 02:26:27.282090 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:27.282099 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:27.282244 (+ 145us) server_negotiation.cc:407] Connection header received
0809 02:26:27.282367 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:27.282369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:27.282438 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:27.282511 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:27.283030 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:27.283569 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:27.284575 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:27.284941 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:27.285078 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:27.287923 (+ 2845us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:59247: BlockingRecv error: recv got EOF from 127.21.214.131:59247 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 02:26:27 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:27 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:27.893728 3882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:27.887710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:44071)
0809 02:26:27.888043 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:27.888058 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:27.888154 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:27.888393 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:27.888395 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:27.888588 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:27.888687 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:27.888692 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:27.889473 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:27.889475 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:27.890029 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:27.890036 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:27.890567 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:27.890569 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:27.890635 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:27.891220 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:27.891236 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:27.893556 (+ 2320us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":94,"threads_started":1}
W20260809 02:26:27.893848 3884 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:27.887857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:44071 (local address 127.21.214.190:46545)
0809 02:26:27.888107 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:27.888110 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:27.888170 (+ 60us) server_negotiation.cc:407] Connection header received
0809 02:26:27.888232 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:27.888234 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:27.888278 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:27.888348 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:27.888827 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:27.889373 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:27.890166 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:27.890385 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:27.890553 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:27.893703 (+ 3150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:44071: BlockingRecv error: recv got EOF from 127.21.214.129:44071 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":62,"threads_started":1}
Aug 09 02:26:28 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:28 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:28.100559 3885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:28.094583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:55839)
0809 02:26:28.094899 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:28.094917 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:28.095045 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:28.095381 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:28.095384 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:28.095583 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:28.095695 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:28.095700 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:28.096559 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:28.096562 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:28.097142 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:28.097151 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:28.097635 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:28.097638 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:28.097705 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:28.098313 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:28.098335 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:28.100436 (+ 2101us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":111,"threads_started":1}
W20260809 02:26:28.100780 3884 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:28.094707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:55839 (local address 127.21.214.190:46545)
0809 02:26:28.094868 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:28.094872 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:28.095035 (+ 163us) server_negotiation.cc:407] Connection header received
0809 02:26:28.095134 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:28.095136 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:28.095187 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:28.095267 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:28.095845 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:28.096432 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:28.097288 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:28.097528 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:28.097612 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:28.100619 (+ 3007us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:55839: BlockingRecv error: recv got EOF from 127.21.214.130:55839 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 02:26:28 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:28 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:28.295046 3886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:28.288868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:45041)
0809 02:26:28.289246 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:28.289265 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:28.289384 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:28.289750 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:28.289756 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:28.289999 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:28.290143 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:28.290151 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:28.291067 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:28.291070 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:28.291638 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:28.291648 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:28.292080 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:28.292083 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:28.292146 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:28.292866 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:28.292888 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:28.294863 (+ 1975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":128,"threads_started":1}
W20260809 02:26:28.295102 3884 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:28.288972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:45041 (local address 127.21.214.190:46545)
0809 02:26:28.289137 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:28.289142 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:28.289358 (+ 216us) server_negotiation.cc:407] Connection header received
0809 02:26:28.289510 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:28.289512 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:28.289561 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:28.289670 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:28.290273 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:28.290964 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:28.291769 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:28.291979 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:28.292056 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:28.294995 (+ 2939us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:45041: BlockingRecv error: recv got EOF from 127.21.214.131:45041 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 09 02:26:28 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:28 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:28.900767 3887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:28.894682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:48489)
0809 02:26:28.894988 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:28.895007 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:28.895119 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:28.895364 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:28.895367 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:28.895572 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:28.895676 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:28.895681 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:28.896607 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:28.896610 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:28.897261 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:28.897271 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:28.897773 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:28.897776 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:28.897866 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:28.898439 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:28.898453 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:28.900624 (+ 2171us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":75,"threads_started":1}
W20260809 02:26:28.901042 3888 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:28.894859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:48489 (local address 127.21.214.190:46545)
0809 02:26:28.895131 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:28.895135 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:28.895150 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:26:28.895190 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:28.895191 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:28.895234 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:28.895318 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:28.895825 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:28.896446 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:28.897405 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:28.897644 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:28.897734 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:28.900865 (+ 3131us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:48489: BlockingRecv error: recv got EOF from 127.21.214.129:48489 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":83,"threads_started":1}
Aug 09 02:26:29 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:29 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:29.107259 3889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:29.101450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:44761)
0809 02:26:29.101852 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:29.101866 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:29.102013 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:29.102310 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:29.102312 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:29.102532 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:29.102635 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:29.102641 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:29.103536 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:29.103539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:29.104112 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:29.104121 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:29.104578 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:29.104581 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:29.104645 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:29.105147 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:29.105190 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:29.107122 (+ 1932us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":113,"threads_started":1}
W20260809 02:26:29.107393 3888 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:29.101628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:44761 (local address 127.21.214.190:46545)
0809 02:26:29.101765 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:29.101769 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:29.101953 (+ 184us) server_negotiation.cc:407] Connection header received
0809 02:26:29.102128 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:29.102138 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:29.102192 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:29.102259 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:29.102771 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:29.103409 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:29.104255 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:29.104474 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:29.104555 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:29.107271 (+ 2716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:44761: BlockingRecv error: recv got EOF from 127.21.214.130:44761 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 02:26:29 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:29 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:29.308113 3890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:29.296098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:37461)
0809 02:26:29.296474 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:29.296487 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:29.296640 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:29.296939 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:29.296943 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:29.297165 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:29.297268 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:29.297274 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:29.298088 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:29.298093 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:29.298783 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:29.298796 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:29.299753 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:29.299759 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:29.299841 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:29.305542 (+ 5701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:29.305556 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:29.307897 (+ 2341us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":122,"threads_started":1}
W20260809 02:26:29.308487 3888 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:29.296152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:37461 (local address 127.21.214.190:46545)
0809 02:26:29.296300 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:29.296305 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:29.296581 (+ 276us) server_negotiation.cc:407] Connection header received
0809 02:26:29.296747 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:29.296753 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:29.296813 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:29.296906 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:29.297428 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:29.297967 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:29.298959 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:29.299571 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:29.299776 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:29.308283 (+ 8507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:37461: BlockingRecv error: recv got EOF from 127.21.214.131:37461 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 02:26:29 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:29 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:29.908635 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:29.901698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:32895)
0809 02:26:29.902016 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:29.902031 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:29.902134 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:29.902516 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:29.902519 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:29.902737 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:29.902840 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:29.902846 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:29.903701 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:29.903706 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:29.904637 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:29.904651 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:29.905335 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:29.905339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:29.905432 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:29.906100 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:29.906113 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:29.908443 (+ 2330us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":117,"threads_started":1}
W20260809 02:26:29.908908 3892 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:29.901825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:32895 (local address 127.21.214.190:46545)
0809 02:26:29.902138 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:29.902142 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:29.902157 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:26:29.902198 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:29.902200 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:29.902250 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:29.902340 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:29.902996 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:29.903557 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:29.904797 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:29.905150 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:29.905321 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:29.908759 (+ 3438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:32895: BlockingRecv error: recv got EOF from 127.21.214.129:32895 (error 108)
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":94,"threads_started":1}
Aug 09 02:26:30 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:30 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:30.114593 3893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:30.108321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:55569)
0809 02:26:30.108690 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:30.108704 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:30.108848 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:30.109207 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:30.109230 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:30.109455 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:30.109573 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:30.109580 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:30.110473 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:30.110477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:30.111142 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:30.111151 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:30.111682 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:30.111686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:30.111784 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:30.112344 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:30.112357 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:30.114396 (+ 2039us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":107,"threads_started":1}
W20260809 02:26:30.114832 3892 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:30.108303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:55569 (local address 127.21.214.190:46545)
0809 02:26:30.108514 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:30.108521 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:30.108786 (+ 265us) server_negotiation.cc:407] Connection header received
0809 02:26:30.108967 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:30.108970 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:30.109030 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:30.109120 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:30.109718 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:30.110306 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:30.111286 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:30.111543 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:30.111679 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:30.114695 (+ 3016us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:55569: BlockingRecv error: recv got EOF from 127.21.214.130:55569 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 09 02:26:30 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:30 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.131@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:30.314826 3897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:30.308984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.131:59113)
0809 02:26:30.309337 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:30.309354 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:30.309480 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:30.309813 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:30.309816 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:30.310012 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:30.310112 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:30.310117 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:30.311060 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:30.311063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:30.311647 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:30.311657 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:30.312106 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:30.312108 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:30.312173 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:30.312764 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:30.312777 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:30.314688 (+ 1911us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":142,"threads_started":1}
W20260809 02:26:30.314998 3892 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:30.309088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:59113 (local address 127.21.214.190:46545)
0809 02:26:30.309274 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:30.309279 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:30.309420 (+ 141us) server_negotiation.cc:407] Connection header received
0809 02:26:30.309648 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:30.309651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:30.309702 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:30.309772 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:30.310253 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:30.310930 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:30.311767 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:30.312004 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:30.312095 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:30.314841 (+ 2746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.131:59113: BlockingRecv error: recv got EOF from 127.21.214.131:59113 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 09 02:26:30 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:30 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.129@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:30.915591 3899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:30.909630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.129:54991)
0809 02:26:30.909966 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:30.910000 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:30.910132 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:30.910369 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:30.910371 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:30.910589 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:30.910695 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:30.910701 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:30.911606 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:30.911609 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:30.912215 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:30.912224 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:30.912727 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:30.912730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:30.912801 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:30.913388 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:30.913401 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:30.915459 (+ 2058us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":95,"threads_started":1}
W20260809 02:26:30.915781 3900 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:30.909770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:54991 (local address 127.21.214.190:46545)
0809 02:26:30.910033 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:30.910036 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:30.910147 (+ 111us) server_negotiation.cc:407] Connection header received
0809 02:26:30.910193 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:30.910195 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:30.910247 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:30.910331 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:30.910824 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:30.911460 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:30.912346 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:30.912594 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:30.912689 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:30.915635 (+ 2946us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.129:54991: BlockingRecv error: recv got EOF from 127.21.214.129:54991 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":69,"threads_started":1}
Aug 09 02:26:31 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 02:26:31 dist-test-slave-68xk krb5kdc[2419](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.21.214.130@KRBTEST.COM for oryx/127.21.214.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 02:26:31.121338 3903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:31.115558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:46545 (local address 127.21.214.130:57315)
0809 02:26:31.115834 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:31.115847 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:31.115942 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:31.116221 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:31.116225 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:31.116491 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:31.116635 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:31.116642 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.117435 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.117438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:31.118021 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:31.118029 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.118544 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.118547 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:31.118620 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:31.119151 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:31.119164 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:31.121140 (+ 1976us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.21.214.190:46545: Server oryx/127.21.214.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":89,"threads_started":1}
W20260809 02:26:31.121371 3900 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:31.115585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:57315 (local address 127.21.214.190:46545)
0809 02:26:31.115764 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:31.115769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:31.115933 (+ 164us) server_negotiation.cc:407] Connection header received
0809 02:26:31.116016 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:31.116019 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:31.116085 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:31.116169 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:31.116774 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.117326 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.118141 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.118365 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.118529 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:31.121269 (+ 2740us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.21.214.130:57315: BlockingRecv error: recv got EOF from 127.21.214.130:57315 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 02:26:31.173084 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 3237
I20260809 02:26:31.202216 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 3438
I20260809 02:26:31.220072 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 3622
I20260809 02:26:31.236240 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 3141
2026-08-09T02:26:31Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18359 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T02:26:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:26:31Z Disabled control of system clock
I20260809 02:26:31.280834 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:41947
--webserver_interface=127.21.214.190
--webserver_port=0
--builtin_ntp_servers=127.21.214.148:46533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:41947
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 02:26:31.398159 3910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:31.398474 3910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:31.398528 3910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:31.403982 3910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:26:31.404044 3910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:31.404060 3910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:31.404078 3910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:26:31.404093 3910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:26:31.408917 3910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:46533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:41947
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:41947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:31.410037 3910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:31.411515 3910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:31.420657 3916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:31.420666 3917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:31.422732 3919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:31.422801 3910 server_base.cc:1034] running on GCE node
I20260809 02:26:31.423414 3910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:31.424575 3910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:31.425748 3910 hybrid_clock.cc:648] HybridClock initialized: now 1786242391425735 us; error 27 us; skew 500 ppm
I20260809 02:26:31.428045 3910 webserver.cc:460] Webserver started at http://127.21.214.190:41145/ using document root <none> and password file <none>
I20260809 02:26:31.428678 3910 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:31.428742 3910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:31.428972 3910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:31.431139 3910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "1ae98fa21b8948ec8335e09e0e3483e4"
format_stamp: "Formatted at 2026-08-09 02:26:31 on dist-test-slave-68xk"
server_key: "19d73c7219b19b8df273e2b686092e7d"
server_key_iv: "736de3db0d42108cecff63efa647c8bb"
server_key_version: "encryptionkey@0"
I20260809 02:26:31.431703 3910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "1ae98fa21b8948ec8335e09e0e3483e4"
format_stamp: "Formatted at 2026-08-09 02:26:31 on dist-test-slave-68xk"
server_key: "19d73c7219b19b8df273e2b686092e7d"
server_key_iv: "736de3db0d42108cecff63efa647c8bb"
server_key_version: "encryptionkey@0"
I20260809 02:26:31.435497 3910 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 02:26:31.437906 3926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:31.439314 3910 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:26:31.439472 3910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "1ae98fa21b8948ec8335e09e0e3483e4"
format_stamp: "Formatted at 2026-08-09 02:26:31 on dist-test-slave-68xk"
server_key: "19d73c7219b19b8df273e2b686092e7d"
server_key_iv: "736de3db0d42108cecff63efa647c8bb"
server_key_version: "encryptionkey@0"
I20260809 02:26:31.439599 3910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:31.458900 3910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:31.459581 3910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:31.459846 3910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:31.468012 3910 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:41947
I20260809 02:26:31.468027 4002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:41947 every 8 connection(s)
I20260809 02:26:31.469352 3910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:26:31.472785 4003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:31.477607 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 3910
I20260809 02:26:31.477741 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:26:31.478102 22362 external_mini_cluster.cc:1428] Setting key 33fd1658339bb1a7d859c89cac230457
I20260809 02:26:31.478806 4003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4: Bootstrap starting.
I20260809 02:26:31.481292 4003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:31.482311 4003 log.cc:824] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:31.484454 4003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4: No bootstrap required, opened a new log
I20260809 02:26:31.488217 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:31.479638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33608 (local address 127.21.214.190:41947)
0809 02:26:31.480297 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:31.480312 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:31.480349 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:26:31.481035 (+ 686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:31.481052 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:31.481533 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:31.481832 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:31.482222 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.483374 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.484595 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.485088 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.485224 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:31.486163 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:31.486168 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:31.486181 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:26:31.486708 (+ 527us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:31.486778 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:26:31.486801 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:31.486891 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:31.487074 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 02:26:31.487396 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":143,"threads_started":1}
I20260809 02:26:31.488745 4003 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ae98fa21b8948ec8335e09e0e3483e4" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 41947 } }
I20260809 02:26:31.488962 4003 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:31.489030 4003 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ae98fa21b8948ec8335e09e0e3483e4, State: Initialized, Role: FOLLOWER
I20260809 02:26:31.489426 4003 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ae98fa21b8948ec8335e09e0e3483e4" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 41947 } }
I20260809 02:26:31.489583 4003 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:26:31.489674 4003 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:26:31.489810 4003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:31.490790 4003 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ae98fa21b8948ec8335e09e0e3483e4" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 41947 } }
I20260809 02:26:31.491132 4003 leader_election.cc:302] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ae98fa21b8948ec8335e09e0e3483e4; no voters:
I20260809 02:26:31.491438 4003 leader_election.cc:288] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:26:31.491611 4008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:31.491905 4008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [term 1 LEADER]: Becoming Leader. State: Replica: 1ae98fa21b8948ec8335e09e0e3483e4, State: Running, Role: LEADER
I20260809 02:26:31.492297 4008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ae98fa21b8948ec8335e09e0e3483e4" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 41947 } }
I20260809 02:26:31.492677 4003 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:26:31.493981 4010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ae98fa21b8948ec8335e09e0e3483e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ae98fa21b8948ec8335e09e0e3483e4" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 41947 } } }
I20260809 02:26:31.494132 4010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:31.494679 4020 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:26:31.494634 4011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ae98fa21b8948ec8335e09e0e3483e4. Latest consensus state: current_term: 1 leader_uuid: "1ae98fa21b8948ec8335e09e0e3483e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ae98fa21b8948ec8335e09e0e3483e4" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 41947 } } }
I20260809 02:26:31.495065 4011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4 [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:31.498183 4020 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:26:31.503436 4020 catalog_manager.cc:1347] Generated new cluster ID: a2c07196482943908a8d0f53316629cf
I20260809 02:26:31.503504 4020 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:26:31.522049 4020 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:26:31.523257 4020 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:26:31.529660 4020 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ae98fa21b8948ec8335e09e0e3483e4: Generated new TSK 0
I20260809 02:26:31.530597 4020 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:26:31.534862 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:41947
--builtin_ntp_servers=127.21.214.148:46533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 02:26:31.651813 4032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:31.652063 4032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:31.652132 4032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:31.656095 4032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:31.656153 4032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:31.656239 4032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:26:31.661620 4032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:46533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:41947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:31.662873 4032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:31.664394 4032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:31.674672 4042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:31.674677 4045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:31.674664 4043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:31.675114 4032 server_base.cc:1034] running on GCE node
I20260809 02:26:31.675572 4032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:31.676260 4032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:31.677462 4032 hybrid_clock.cc:648] HybridClock initialized: now 1786242391677445 us; error 27 us; skew 500 ppm
I20260809 02:26:31.679505 4032 webserver.cc:460] Webserver started at http://127.21.214.129:33337/ using document root <none> and password file <none>
I20260809 02:26:31.680109 4032 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:31.680220 4032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:31.680466 4032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:31.682636 4032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "2582b594ef0945cab6f388450e7ea91b"
format_stamp: "Formatted at 2026-08-09 02:26:31 on dist-test-slave-68xk"
server_key: "c8a22036cf50fc2dddf2c9ae57a06dc7"
server_key_iv: "619ca198b8e6a5b9572aebf2ca6adc1e"
server_key_version: "encryptionkey@0"
I20260809 02:26:31.683234 4032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "2582b594ef0945cab6f388450e7ea91b"
format_stamp: "Formatted at 2026-08-09 02:26:31 on dist-test-slave-68xk"
server_key: "c8a22036cf50fc2dddf2c9ae57a06dc7"
server_key_iv: "619ca198b8e6a5b9572aebf2ca6adc1e"
server_key_version: "encryptionkey@0"
I20260809 02:26:31.687075 4032 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 02:26:31.689736 4053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:31.691068 4032 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:26:31.691253 4032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "2582b594ef0945cab6f388450e7ea91b"
format_stamp: "Formatted at 2026-08-09 02:26:31 on dist-test-slave-68xk"
server_key: "c8a22036cf50fc2dddf2c9ae57a06dc7"
server_key_iv: "619ca198b8e6a5b9572aebf2ca6adc1e"
server_key_version: "encryptionkey@0"
I20260809 02:26:31.691375 4032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:31.711964 4032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:31.712663 4032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:31.712921 4032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:31.713565 4032 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:31.714573 4032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:31.714654 4032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:31.714730 4032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:31.714774 4032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:31.724814 4032 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:42489
I20260809 02:26:31.724855 4210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:42489 every 8 connection(s)
I20260809 02:26:31.725770 4032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:26:31.733448 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 4032
I20260809 02:26:31.733567 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:26:31.733938 22362 external_mini_cluster.cc:1428] Setting key e2880a1ce57ad607f7d8e3847d8a47ed
I20260809 02:26:31.735669 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:31.727701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:48303 (local address 127.21.214.190:41947)
0809 02:26:31.727902 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:31.727907 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:31.729018 (+ 1111us) server_negotiation.cc:407] Connection header received
0809 02:26:31.730498 (+ 1480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:31.730501 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:31.730563 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:31.730655 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:31.731609 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.732178 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.733379 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.733749 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.733863 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:31.735115 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:31.735120 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:31.735125 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:26:31.735140 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:31.735165 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:26:31.735178 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:31.735253 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:31.735465 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 02:26:31.735528 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 02:26:31.736066 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:41947
--builtin_ntp_servers=127.21.214.148:46533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 02:26:31.736605 4213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:31.728131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:41947 (local address 127.21.214.129:48303)
0809 02:26:31.728855 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:31.728896 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:31.730199 (+ 1303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:31.730828 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:31.730834 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:31.730918 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:31.731449 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:31.731463 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.732321 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.732324 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:31.733236 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:31.733246 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.733925 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.733928 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:31.734128 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:31.734854 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:26:31.734855 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:31.734895 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:26:31.734955 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:31.735285 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:31.735296 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:31.735303 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 02:26:31.735444 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 02:26:31.735683 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":124,"threads_started":1}
I20260809 02:26:31.737823 4211 heartbeater.cc:347] Connected to a master server at 127.21.214.190:41947
I20260809 02:26:31.738091 4211 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:31.738657 4211 heartbeater.cc:511] Master 127.21.214.190:41947 requested a full tablet report, sending...
I20260809 02:26:31.740229 3950 ts_manager.cc:194] Registered new tserver with Master: 2582b594ef0945cab6f388450e7ea91b (127.21.214.129:42489)
I20260809 02:26:31.741452 3950 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.214.129:48303
W20260809 02:26:31.853528 4215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:31.853832 4215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:31.853905 4215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:31.858001 4215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:31.858100 4215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:31.858194 4215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:26:31.862941 4215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:46533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:41947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:31.864086 4215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:31.865533 4215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:31.875435 4223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:31.875420 4221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:31.875476 4220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:31.875787 4215 server_base.cc:1034] running on GCE node
I20260809 02:26:31.876188 4215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:31.876807 4215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:31.877998 4215 hybrid_clock.cc:648] HybridClock initialized: now 1786242391877964 us; error 44 us; skew 500 ppm
I20260809 02:26:31.880024 4215 webserver.cc:460] Webserver started at http://127.21.214.130:37671/ using document root <none> and password file <none>
I20260809 02:26:31.880618 4215 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:31.880684 4215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:31.880864 4215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:31.883072 4215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "648a25ea37c547d5ac68fd60e4a7fc6e"
format_stamp: "Formatted at 2026-08-09 02:26:31 on dist-test-slave-68xk"
server_key: "f71a9185fc3887cfea86918840008b8a"
server_key_iv: "1fbb4d02bac652d9fe8950fa5ec3f8ea"
server_key_version: "encryptionkey@0"
I20260809 02:26:31.883610 4215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "648a25ea37c547d5ac68fd60e4a7fc6e"
format_stamp: "Formatted at 2026-08-09 02:26:31 on dist-test-slave-68xk"
server_key: "f71a9185fc3887cfea86918840008b8a"
server_key_iv: "1fbb4d02bac652d9fe8950fa5ec3f8ea"
server_key_version: "encryptionkey@0"
I20260809 02:26:31.887440 4215 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:26:31.890070 4231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:31.891386 4215 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:26:31.891538 4215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "648a25ea37c547d5ac68fd60e4a7fc6e"
format_stamp: "Formatted at 2026-08-09 02:26:31 on dist-test-slave-68xk"
server_key: "f71a9185fc3887cfea86918840008b8a"
server_key_iv: "1fbb4d02bac652d9fe8950fa5ec3f8ea"
server_key_version: "encryptionkey@0"
I20260809 02:26:31.891664 4215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:31.919133 4215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:31.919902 4215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:31.920130 4215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:31.920769 4215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:31.921800 4215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:31.921877 4215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:31.921952 4215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:31.921995 4215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:31.932652 4215 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:39199
I20260809 02:26:31.932715 4395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:39199 every 8 connection(s)
I20260809 02:26:31.933635 4215 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:26:31.934358 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 4215
I20260809 02:26:31.934518 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:26:31.934877 22362 external_mini_cluster.cc:1428] Setting key dd30bbafd612ade5c0acbba26a2aa1a0
I20260809 02:26:31.937193 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:41947
--builtin_ntp_servers=127.21.214.148:46533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 02:26:31.945389 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:31.935824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:44753 (local address 127.21.214.190:41947)
0809 02:26:31.935976 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:31.935982 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:31.937299 (+ 1317us) server_negotiation.cc:407] Connection header received
0809 02:26:31.938903 (+ 1604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:31.938909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:31.938976 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:31.939083 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:31.940396 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.940936 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.942889 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.943113 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.943205 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:31.944832 (+ 1627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:31.944835 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:31.944840 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:26:31.944854 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:31.944874 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:26:31.944882 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:31.944945 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:31.945175 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 02:26:31.945260 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 02:26:31.946796 4399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:31.936294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:41947 (local address 127.21.214.130:44753)
0809 02:26:31.937116 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:31.937171 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:31.938676 (+ 1505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:31.939310 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:31.939321 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:31.939444 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:31.940202 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:31.940226 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.941073 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.941080 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:31.942727 (+ 1647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:31.942743 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:31.943297 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:31.943304 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:31.943555 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:31.944463 (+ 908us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:26:31.944467 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:31.944533 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:26:31.944640 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:31.944981 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:31.944995 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:31.945004 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 02:26:31.945174 (+ 170us) client_negotiation.cc:240] Negotiation successful
0809 02:26:31.945546 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":151,"threads_started":1}
I20260809 02:26:31.948186 4397 heartbeater.cc:347] Connected to a master server at 127.21.214.190:41947
I20260809 02:26:31.948484 4397 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:31.949075 4397 heartbeater.cc:511] Master 127.21.214.190:41947 requested a full tablet report, sending...
I20260809 02:26:31.950280 3950 ts_manager.cc:194] Registered new tserver with Master: 648a25ea37c547d5ac68fd60e4a7fc6e (127.21.214.130:39199)
I20260809 02:26:31.950932 3950 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.214.130:44753
W20260809 02:26:32.058528 4400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:32.058790 4400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:32.058876 4400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:32.063401 4400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:32.063454 4400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:32.063547 4400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:26:32.068781 4400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:46533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:41947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:32.069871 4400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:32.071376 4400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:26:32.081816 4400 server_base.cc:1034] running on GCE node
W20260809 02:26:32.081909 4411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:32.081892 4407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:32.082019 4408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:32.082597 4400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:32.083197 4400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:32.084378 4400 hybrid_clock.cc:648] HybridClock initialized: now 1786242392084343 us; error 45 us; skew 500 ppm
I20260809 02:26:32.086349 4400 webserver.cc:460] Webserver started at http://127.21.214.131:33645/ using document root <none> and password file <none>
I20260809 02:26:32.086977 4400 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:32.087042 4400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:32.087273 4400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:32.089385 4400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "328ec9de31264fbcb8d852812cc5453b"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "5b312ec6cfc6a04792eab994ef5a24c7"
server_key_iv: "a75a03b838966782d112ee9e5e787e1e"
server_key_version: "encryptionkey@0"
I20260809 02:26:32.089977 4400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "328ec9de31264fbcb8d852812cc5453b"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "5b312ec6cfc6a04792eab994ef5a24c7"
server_key_iv: "a75a03b838966782d112ee9e5e787e1e"
server_key_version: "encryptionkey@0"
I20260809 02:26:32.093988 4400 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 02:26:32.096937 4420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:32.098250 4400 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:26:32.098385 4400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "328ec9de31264fbcb8d852812cc5453b"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "5b312ec6cfc6a04792eab994ef5a24c7"
server_key_iv: "a75a03b838966782d112ee9e5e787e1e"
server_key_version: "encryptionkey@0"
I20260809 02:26:32.098551 4400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:32.120293 4400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:32.121001 4400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:32.121203 4400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:32.121785 4400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:32.122794 4400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:32.122871 4400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:32.122946 4400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:32.122996 4400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:32.133159 4400 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:34875
I20260809 02:26:32.133195 4588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:34875 every 8 connection(s)
I20260809 02:26:32.134068 4400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:26:32.135866 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 4400
I20260809 02:26:32.135983 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:26:32.136312 22362 external_mini_cluster.cc:1428] Setting key 711b04ece5ec8a6db8c093bec5700eed
I20260809 02:26:32.144109 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:32.136126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:36339 (local address 127.21.214.190:41947)
0809 02:26:32.136311 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:32.136315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:32.137725 (+ 1410us) server_negotiation.cc:407] Connection header received
0809 02:26:32.139499 (+ 1774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:32.139501 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:32.139547 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:32.139615 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:32.140462 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:32.140983 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:32.142166 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:32.142382 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:32.142529 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:32.143642 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:32.143645 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:32.143647 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:26:32.143659 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:32.143678 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:26:32.143703 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:32.143770 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:32.143947 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 02:26:32.143997 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 02:26:32.145001 4591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:32.136647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:41947 (local address 127.21.214.131:36339)
0809 02:26:32.137560 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:32.137629 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:32.139314 (+ 1685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:32.139753 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:32.139759 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:32.139839 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:32.140337 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:32.140351 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:32.141112 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:32.141115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:32.142058 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:32.142068 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:32.142551 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:32.142553 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:32.142702 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:32.143383 (+ 681us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:26:32.143385 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:32.143425 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:26:32.143497 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:32.143806 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:32.143815 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:32.143827 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 02:26:32.143928 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 02:26:32.144148 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":148,"threads_started":1}
I20260809 02:26:32.146154 4589 heartbeater.cc:347] Connected to a master server at 127.21.214.190:41947
I20260809 02:26:32.146404 4589 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:32.146970 4589 heartbeater.cc:511] Master 127.21.214.190:41947 requested a full tablet report, sending...
I20260809 02:26:32.148000 3950 ts_manager.cc:194] Registered new tserver with Master: 328ec9de31264fbcb8d852812cc5453b (127.21.214.131:34875)
I20260809 02:26:32.148597 3950 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.214.131:36339
I20260809 02:26:32.150651 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 02:26:32.153757 4006 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:32.152657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33612 (local address 127.21.214.190:41947)
0809 02:26:32.152820 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:32.152825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:32.152996 (+ 171us) server_negotiation.cc:407] Connection header received
0809 02:26:32.153179 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:32.153182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:32.153233 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:32.153324 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:32.153639 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33612: BlockingRecv error: recv got EOF from 127.0.0.1:33612 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:26:32.154206 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 4032
I20260809 02:26:32.171593 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 4215
I20260809 02:26:32.183445 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 4400
I20260809 02:26:32.194895 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 3910
2026-08-09T02:26:32Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (951 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T02:26:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:26:32Z Disabled control of system clock
I20260809 02:26:32.230044 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:35835
--webserver_interface=127.21.214.190
--webserver_port=0
--builtin_ntp_servers=127.21.214.148:37853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:35835
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 02:26:32.342159 4603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:32.342514 4603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:32.342618 4603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:32.346661 4603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:26:32.346761 4603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:32.346792 4603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:32.346832 4603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:26:32.346890 4603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:26:32.351622 4603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:37853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:35835
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:35835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:32.352787 4603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:32.354235 4603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:32.363027 4614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:32.363080 4611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:32.363103 4612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:32.363255 4603 server_base.cc:1034] running on GCE node
I20260809 02:26:32.363883 4603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:32.364995 4603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:32.366218 4603 hybrid_clock.cc:648] HybridClock initialized: now 1786242392366195 us; error 33 us; skew 500 ppm
I20260809 02:26:32.368414 4603 webserver.cc:460] Webserver started at http://127.21.214.190:35207/ using document root <none> and password file <none>
I20260809 02:26:32.369064 4603 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:32.369135 4603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:32.369369 4603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:32.371562 4603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "e3354dc980524ed4a1e3754c42836f9a"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "ad12e152e8824612f056311e07e80e31"
server_key_iv: "dcec2aa35e2bcc43785bc830bc1cc95c"
server_key_version: "encryptionkey@0"
I20260809 02:26:32.372145 4603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "e3354dc980524ed4a1e3754c42836f9a"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "ad12e152e8824612f056311e07e80e31"
server_key_iv: "dcec2aa35e2bcc43785bc830bc1cc95c"
server_key_version: "encryptionkey@0"
I20260809 02:26:32.376210 4603 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 02:26:32.378902 4622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:32.380336 4603 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:26:32.380515 4603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "e3354dc980524ed4a1e3754c42836f9a"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "ad12e152e8824612f056311e07e80e31"
server_key_iv: "dcec2aa35e2bcc43785bc830bc1cc95c"
server_key_version: "encryptionkey@0"
I20260809 02:26:32.380652 4603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:32.386065 4603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:32.386888 4603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:32.387115 4603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:32.395076 4603 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:35835
I20260809 02:26:32.395139 4700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:35835 every 8 connection(s)
I20260809 02:26:32.396330 4603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:26:32.400004 4702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:32.406075 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 4603
I20260809 02:26:32.406225 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:26:32.406584 22362 external_mini_cluster.cc:1428] Setting key 8738cb78c2a86c38da7c1b342dc2241b
I20260809 02:26:32.406986 4702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a: Bootstrap starting.
I20260809 02:26:32.409951 4702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:32.410996 4702 log.cc:824] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:32.412668 4706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:32.408205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55298 (local address 127.21.214.190:35835)
0809 02:26:32.408966 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:32.408983 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:32.409022 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:26:32.409680 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:32.409710 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:32.410115 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:32.410487 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:32.411374 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:32.411378 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:32.411390 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:26:32.411400 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:32.411464 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:26:32.411480 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:32.411611 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:32.411756 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 02:26:32.411995 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":158,"threads_started":1}
I20260809 02:26:32.413237 4702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a: No bootstrap required, opened a new log
I20260809 02:26:32.417142 4702 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3354dc980524ed4a1e3754c42836f9a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 35835 } }
I20260809 02:26:32.417362 4702 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:32.417421 4702 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3354dc980524ed4a1e3754c42836f9a, State: Initialized, Role: FOLLOWER
I20260809 02:26:32.417833 4702 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3354dc980524ed4a1e3754c42836f9a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 35835 } }
I20260809 02:26:32.417953 4702 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:26:32.418040 4702 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:26:32.418141 4702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:32.419123 4702 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3354dc980524ed4a1e3754c42836f9a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 35835 } }
I20260809 02:26:32.419456 4702 leader_election.cc:302] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3354dc980524ed4a1e3754c42836f9a; no voters:
I20260809 02:26:32.419756 4702 leader_election.cc:288] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:26:32.419896 4709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:32.420248 4709 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [term 1 LEADER]: Becoming Leader. State: Replica: e3354dc980524ed4a1e3754c42836f9a, State: Running, Role: LEADER
I20260809 02:26:32.420645 4709 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3354dc980524ed4a1e3754c42836f9a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 35835 } }
I20260809 02:26:32.421020 4702 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:26:32.422838 4711 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3354dc980524ed4a1e3754c42836f9a. Latest consensus state: current_term: 1 leader_uuid: "e3354dc980524ed4a1e3754c42836f9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3354dc980524ed4a1e3754c42836f9a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 35835 } } }
I20260809 02:26:32.422984 4711 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:32.423302 4710 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3354dc980524ed4a1e3754c42836f9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3354dc980524ed4a1e3754c42836f9a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 35835 } } }
I20260809 02:26:32.423422 4710 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:32.423637 4720 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:26:32.426975 4720 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:26:32.432406 4720 catalog_manager.cc:1347] Generated new cluster ID: 9639e06beeb1413aa99174fdaa2ee4ea
I20260809 02:26:32.432474 4720 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:26:32.470854 4720 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:26:32.471232 4720 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:26:32.482196 4720 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3354dc980524ed4a1e3754c42836f9a: Generated new TSK 0
I20260809 02:26:32.482981 4720 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:26:32.490535 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:35835
--builtin_ntp_servers=127.21.214.148:37853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 02:26:32.606914 4736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:32.607214 4736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:32.607262 4736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:32.611274 4736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:32.611363 4736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:32.611456 4736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:26:32.616182 4736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:37853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:35835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:32.617288 4736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:32.618750 4736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:32.629101 4744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:32.629107 4743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:32.629112 4747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:32.629249 4736 server_base.cc:1034] running on GCE node
I20260809 02:26:32.629957 4736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:32.630684 4736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:32.631891 4736 hybrid_clock.cc:648] HybridClock initialized: now 1786242392631875 us; error 26 us; skew 500 ppm
I20260809 02:26:32.633908 4736 webserver.cc:460] Webserver started at http://127.21.214.129:44205/ using document root <none> and password file <none>
I20260809 02:26:32.634572 4736 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:32.634675 4736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:32.634923 4736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:32.637065 4736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "50abd29c52104fb8a5714be258b04842"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "5b7cb0106166827e3d4eeb6479a759ec"
server_key_iv: "fc8ec91f861ba7d7e9a6aea7bbfb0efd"
server_key_version: "encryptionkey@0"
I20260809 02:26:32.637651 4736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "50abd29c52104fb8a5714be258b04842"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "5b7cb0106166827e3d4eeb6479a759ec"
server_key_iv: "fc8ec91f861ba7d7e9a6aea7bbfb0efd"
server_key_version: "encryptionkey@0"
I20260809 02:26:32.641459 4736 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 02:26:32.644129 4756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:32.645407 4736 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:26:32.645552 4736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "50abd29c52104fb8a5714be258b04842"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "5b7cb0106166827e3d4eeb6479a759ec"
server_key_iv: "fc8ec91f861ba7d7e9a6aea7bbfb0efd"
server_key_version: "encryptionkey@0"
I20260809 02:26:32.645670 4736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:32.650216 4736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:32.650877 4736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:32.651065 4736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:32.651610 4736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:32.652508 4736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:32.652582 4736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:32.652649 4736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:32.652698 4736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:32.661834 4736 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:42465
I20260809 02:26:32.661900 4908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:42465 every 8 connection(s)
I20260809 02:26:32.662809 4736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:26:32.668140 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 4736
I20260809 02:26:32.668272 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:26:32.668645 22362 external_mini_cluster.cc:1428] Setting key 71569a3a4b4ca8541764c14e538d73c6
I20260809 02:26:32.669549 4706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:32.664699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:40891 (local address 127.21.214.190:35835)
0809 02:26:32.664861 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:32.664865 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:32.665947 (+ 1082us) server_negotiation.cc:407] Connection header received
0809 02:26:32.667423 (+ 1476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:32.667426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:32.667473 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:32.667564 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:32.668976 (+ 1412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:32.668980 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:32.668982 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:26:32.668996 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:32.669020 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:26:32.669042 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:32.669184 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:32.669342 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 02:26:32.669406 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 02:26:32.670764 4912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:32.665110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:35835 (local address 127.21.214.129:40891)
0809 02:26:32.665786 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:32.665827 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:32.667160 (+ 1333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:32.667751 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:32.667758 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:32.667902 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:32.668641 (+ 739us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:26:32.668643 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:32.668700 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:26:32.668795 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:32.669173 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:32.669182 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:32.669187 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:26:32.669364 (+ 177us) client_negotiation.cc:240] Negotiation successful
0809 02:26:32.669632 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":124,"threads_started":1}
I20260809 02:26:32.671128 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:35835
--builtin_ntp_servers=127.21.214.148:37853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 02:26:32.672183 4910 heartbeater.cc:347] Connected to a master server at 127.21.214.190:35835
I20260809 02:26:32.672427 4910 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:32.672915 4910 heartbeater.cc:511] Master 127.21.214.190:35835 requested a full tablet report, sending...
I20260809 02:26:32.674845 4655 ts_manager.cc:194] Registered new tserver with Master: 50abd29c52104fb8a5714be258b04842 (127.21.214.129:42465)
W20260809 02:26:32.790248 4913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:32.790567 4913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:32.790611 4913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:32.794633 4913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:32.794690 4913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:32.794746 4913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:26:32.799582 4913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:37853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:35835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:32.800678 4913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:32.802049 4913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:32.811888 4928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:32.811946 4932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:32.812111 4925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:32.812140 4913 server_base.cc:1034] running on GCE node
I20260809 02:26:32.812685 4913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:32.813372 4913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:32.814540 4913 hybrid_clock.cc:648] HybridClock initialized: now 1786242392814529 us; error 35 us; skew 500 ppm
I20260809 02:26:32.816478 4913 webserver.cc:460] Webserver started at http://127.21.214.130:34685/ using document root <none> and password file <none>
I20260809 02:26:32.817088 4913 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:32.817196 4913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:32.817444 4913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:32.819690 4913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "eb3c7b7f3af64a7ea94559517b67543b"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "1f1f03ee2b08e8675663806760b4df14"
server_key_iv: "c73321fd13da48421b93fd91670368e7"
server_key_version: "encryptionkey@0"
I20260809 02:26:32.820295 4913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "eb3c7b7f3af64a7ea94559517b67543b"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "1f1f03ee2b08e8675663806760b4df14"
server_key_iv: "c73321fd13da48421b93fd91670368e7"
server_key_version: "encryptionkey@0"
I20260809 02:26:32.824469 4913 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:26:32.827265 4944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:32.828642 4913 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:26:32.828804 4913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "eb3c7b7f3af64a7ea94559517b67543b"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "1f1f03ee2b08e8675663806760b4df14"
server_key_iv: "c73321fd13da48421b93fd91670368e7"
server_key_version: "encryptionkey@0"
I20260809 02:26:32.828926 4913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:32.833551 4913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:32.834187 4913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:32.834381 4913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:32.835013 4913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:32.835953 4913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:32.836026 4913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:32.836093 4913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:32.836143 4913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:32.846249 4913 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:36589
I20260809 02:26:32.846282 5096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:36589 every 8 connection(s)
I20260809 02:26:32.847232 4913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:26:32.849650 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 4913
I20260809 02:26:32.849792 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:26:32.850167 22362 external_mini_cluster.cc:1428] Setting key 353529c40122c24d7c49aa4d4a9ef53e
I20260809 02:26:32.852496 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:35835
--builtin_ntp_servers=127.21.214.148:37853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 02:26:32.854254 4706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:32.849126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:33005 (local address 127.21.214.190:35835)
0809 02:26:32.849307 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:32.849310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:32.850822 (+ 1512us) server_negotiation.cc:407] Connection header received
0809 02:26:32.852439 (+ 1617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:32.852442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:32.852483 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:32.852561 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:32.853745 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:32.853749 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:32.853752 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:26:32.853764 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:32.853784 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:26:32.853793 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:32.853893 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:32.854064 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 02:26:32.854109 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 02:26:32.855152 5100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:32.849662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:35835 (local address 127.21.214.130:33005)
0809 02:26:32.850607 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:32.850694 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:32.852224 (+ 1530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:32.852740 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:32.852747 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:32.852836 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:32.853471 (+ 635us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:26:32.853473 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:32.853514 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:26:32.853582 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:32.853897 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:32.853909 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:32.853919 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 02:26:32.854110 (+ 191us) client_negotiation.cc:240] Negotiation successful
0809 02:26:32.854357 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":156,"threads_started":1}
I20260809 02:26:32.856323 5097 heartbeater.cc:347] Connected to a master server at 127.21.214.190:35835
I20260809 02:26:32.856573 5097 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:32.856992 5097 heartbeater.cc:511] Master 127.21.214.190:35835 requested a full tablet report, sending...
I20260809 02:26:32.858134 4655 ts_manager.cc:194] Registered new tserver with Master: eb3c7b7f3af64a7ea94559517b67543b (127.21.214.130:36589)
W20260809 02:26:32.970856 5101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:32.971115 5101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:32.971155 5101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:32.975185 5101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:32.975247 5101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:32.975304 5101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:26:32.980052 5101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:37853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:35835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:32.981070 5101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:32.982592 5101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:32.993713 5109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:32.993722 5108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:32.993722 5111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:32.993988 5101 server_base.cc:1034] running on GCE node
I20260809 02:26:32.994506 5101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:32.995177 5101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:32.996376 5101 hybrid_clock.cc:648] HybridClock initialized: now 1786242392996365 us; error 31 us; skew 500 ppm
I20260809 02:26:32.998351 5101 webserver.cc:460] Webserver started at http://127.21.214.131:33229/ using document root <none> and password file <none>
I20260809 02:26:32.998982 5101 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:32.999094 5101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:32.999333 5101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:33.001441 5101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "199c60702b5c4b2d8292159a2a0fc3cb"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "303d2caccc6a20a975389930aba82b2a"
server_key_iv: "e34ff6b198aa2df094dd961742a9fcd9"
server_key_version: "encryptionkey@0"
I20260809 02:26:33.002028 5101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "199c60702b5c4b2d8292159a2a0fc3cb"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "303d2caccc6a20a975389930aba82b2a"
server_key_iv: "e34ff6b198aa2df094dd961742a9fcd9"
server_key_version: "encryptionkey@0"
I20260809 02:26:33.007872 5101 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260809 02:26:33.011265 5120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:33.013091 5101 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:26:33.013245 5101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "199c60702b5c4b2d8292159a2a0fc3cb"
format_stamp: "Formatted at 2026-08-09 02:26:32 on dist-test-slave-68xk"
server_key: "303d2caccc6a20a975389930aba82b2a"
server_key_iv: "e34ff6b198aa2df094dd961742a9fcd9"
server_key_version: "encryptionkey@0"
I20260809 02:26:33.013409 5101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:33.019172 5101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:33.019858 5101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:33.020089 5101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:33.020712 5101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:33.021768 5101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:33.021847 5101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:33.021925 5101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:33.021991 5101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:33.032472 5101 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:33945
I20260809 02:26:33.032512 5274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:33945 every 8 connection(s)
I20260809 02:26:33.033504 5101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:26:33.040560 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 5101
I20260809 02:26:33.040649 4706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:33.035644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:42363 (local address 127.21.214.190:35835)
0809 02:26:33.035815 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:33.035819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:33.036940 (+ 1121us) server_negotiation.cc:407] Connection header received
0809 02:26:33.038590 (+ 1650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:33.038593 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:33.038651 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:33.038777 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:33.040085 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:33.040089 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:33.040092 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:26:33.040106 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:33.040140 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:26:33.040150 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:33.040262 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:33.040435 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 02:26:33.040487 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 02:26:33.040695 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:26:33.041065 22362 external_mini_cluster.cc:1428] Setting key 1a170686e6400a835f12b31a81820100
I20260809 02:26:33.041743 5281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:33.036038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:35835 (local address 127.21.214.131:42363)
0809 02:26:33.036761 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:33.036806 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:33.038297 (+ 1491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:33.038964 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:33.038972 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:33.039064 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:33.039792 (+ 728us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:26:33.039793 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:33.039837 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:26:33.039911 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:33.040257 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:33.040268 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:33.040277 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 02:26:33.040483 (+ 206us) client_negotiation.cc:240] Negotiation successful
0809 02:26:33.040761 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":125,"threads_started":1}
I20260809 02:26:33.043059 5278 heartbeater.cc:347] Connected to a master server at 127.21.214.190:35835
I20260809 02:26:33.043380 5278 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:33.043820 5278 heartbeater.cc:511] Master 127.21.214.190:35835 requested a full tablet report, sending...
I20260809 02:26:33.044934 4655 ts_manager.cc:194] Registered new tserver with Master: 199c60702b5c4b2d8292159a2a0fc3cb (127.21.214.131:33945)
I20260809 02:26:33.055249 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 02:26:33.058153 4706 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:26:33.057266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55300 (local address 127.21.214.190:35835)
0809 02:26:33.057411 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:33.057415 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:33.057645 (+ 230us) server_negotiation.cc:407] Connection header received
0809 02:26:33.057733 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:33.057735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:33.057768 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:33.057841 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:33.058044 (+ 203us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55300: BlockingRecv error: recv got EOF from 127.0.0.1:55300 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 02:26:33.058501 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 4736
I20260809 02:26:33.072851 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 4913
I20260809 02:26:33.087198 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 5101
I20260809 02:26:33.096184 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 4603
2026-08-09T02:26:33Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (902 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:26:33 dist-test-slave-68xk krb5kdc[5294](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:26:33 dist-test-slave-68xk krb5kdc[5294](info): set up 2 sockets
Aug 09 02:26:33 dist-test-slave-68xk krb5kdc[5294](info): commencing operation
krb5kdc: starting...
W20260809 02:26:34.378309 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:26:34 dist-test-slave-68xk krb5kdc[5294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242394, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:26:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:26:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:26:34.514019 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:43519
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:34151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:43519
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:34.627338 5310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:34.627629 5310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:34.627707 5310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:34.631712 5310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:26:34.631800 5310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:34.631842 5310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:34.631878 5310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:26:34.631911 5310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:26:34.637233 5310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:34151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:43519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:43519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:34.638374 5310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:34.639484 5310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:34.648813 5321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:34.648954 5310 server_base.cc:1034] running on GCE node
W20260809 02:26:34.648813 5323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:34.649189 5318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:34.649801 5310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:34.651062 5310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:34.652244 5310 hybrid_clock.cc:648] HybridClock initialized: now 1786242394652228 us; error 32 us; skew 500 ppm
Aug 09 02:26:34 dist-test-slave-68xk krb5kdc[5294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242394, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:34.655155 5310 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:26:34.656116 5310 webserver.cc:460] Webserver started at http://127.21.214.190:40291/ using document root <none> and password file <none>
I20260809 02:26:34.656695 5310 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:34.656793 5310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:34.657034 5310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:34.659179 5310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "bd4edf1f293549e181f9e674707ef364"
format_stamp: "Formatted at 2026-08-09 02:26:34 on dist-test-slave-68xk"
server_key: "2ddab4c4bf151a554ca7e011ec1708ea"
server_key_iv: "6633b95dab9ccf0825892782e51981e6"
server_key_version: "encryptionkey@0"
I20260809 02:26:34.659790 5310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "bd4edf1f293549e181f9e674707ef364"
format_stamp: "Formatted at 2026-08-09 02:26:34 on dist-test-slave-68xk"
server_key: "2ddab4c4bf151a554ca7e011ec1708ea"
server_key_iv: "6633b95dab9ccf0825892782e51981e6"
server_key_version: "encryptionkey@0"
I20260809 02:26:34.663571 5310 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 02:26:34.666141 5334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:34.667497 5310 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:26:34.667647 5310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "bd4edf1f293549e181f9e674707ef364"
format_stamp: "Formatted at 2026-08-09 02:26:34 on dist-test-slave-68xk"
server_key: "2ddab4c4bf151a554ca7e011ec1708ea"
server_key_iv: "6633b95dab9ccf0825892782e51981e6"
server_key_version: "encryptionkey@0"
I20260809 02:26:34.667778 5310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:34.701195 5310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:34.704506 5310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:34.704732 5310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:34.712355 5310 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:43519
I20260809 02:26:34.712389 5401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:43519 every 8 connection(s)
I20260809 02:26:34.713321 5310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:26:34.716290 5402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:34.721589 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 5310
I20260809 02:26:34.721696 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:26:34.722035 22362 external_mini_cluster.cc:1428] Setting key 07f09eee953f307f668dca3bc63d22c0
I20260809 02:26:34.722266 5402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364: Bootstrap starting.
I20260809 02:26:34.724825 5402 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:34.725754 5402 log.cc:824] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:34.728012 5402 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364: No bootstrap required, opened a new log
Aug 09 02:26:34 dist-test-slave-68xk krb5kdc[5294](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242394, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:26:34.732429 5402 raft_consensus.cc:348] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd4edf1f293549e181f9e674707ef364" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43519 } }
I20260809 02:26:34.732676 5402 raft_consensus.cc:374] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:34.732762 5402 raft_consensus.cc:729] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd4edf1f293549e181f9e674707ef364, State: Initialized, Role: FOLLOWER
I20260809 02:26:34.733229 5402 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd4edf1f293549e181f9e674707ef364" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43519 } }
I20260809 02:26:34.733384 5402 raft_consensus.cc:388] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:26:34.733467 5402 raft_consensus.cc:482] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:26:34.733597 5402 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:34.734575 5402 raft_consensus.cc:504] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd4edf1f293549e181f9e674707ef364" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43519 } }
I20260809 02:26:34.734930 5402 leader_election.cc:302] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd4edf1f293549e181f9e674707ef364; no voters:
I20260809 02:26:34.735299 5402 leader_election.cc:288] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:26:34.735376 5407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:34.735596 5407 raft_consensus.cc:686] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [term 1 LEADER]: Becoming Leader. State: Replica: bd4edf1f293549e181f9e674707ef364, State: Running, Role: LEADER
I20260809 02:26:34.735911 5407 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd4edf1f293549e181f9e674707ef364" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43519 } }
I20260809 02:26:34.736678 5402 sys_catalog.cc:564] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:26:34.737129 5410 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd4edf1f293549e181f9e674707ef364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd4edf1f293549e181f9e674707ef364" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43519 } } }
I20260809 02:26:34.737272 5410 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:34.737681 5415 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:26:34.738299 5405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:34.723523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42132 (local address 127.21.214.190:43519)
0809 02:26:34.723990 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:34.724006 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:34.724048 (+ 42us) server_negotiation.cc:407] Connection header received
0809 02:26:34.724703 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:34.724720 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:34.725111 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:34.725402 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:34.726444 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:34.727526 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:34.728654 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:34.729127 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:34.729256 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:34.732135 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:34.732140 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:34.732153 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:34.732181 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:34.734316 (+ 2135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:34.734818 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:34.734825 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:34.734831 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:34.734957 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:34.735293 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:34.735297 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:34.735298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:34.735931 (+ 633us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:34.736133 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:34.736924 (+ 791us) server_negotiation.cc:299] Negotiation successful
0809 02:26:34.737276 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":167,"threads_started":1}
I20260809 02:26:34.739897 5409 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd4edf1f293549e181f9e674707ef364. Latest consensus state: current_term: 1 leader_uuid: "bd4edf1f293549e181f9e674707ef364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd4edf1f293549e181f9e674707ef364" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43519 } } }
I20260809 02:26:34.740000 5409 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364 [sys.catalog]: This master's current role is: LEADER
I20260809 02:26:34.741472 5415 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:26:34.747444 5415 catalog_manager.cc:1347] Generated new cluster ID: 17d3ac87fd8b4b3b830b909f56a38524
I20260809 02:26:34.747519 5415 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:26:34.757339 5415 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:26:34.758522 5415 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:26:34.764110 5415 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364: Generated new TSK 0
I20260809 02:26:34.764824 5415 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:26:34.801918 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:43519
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:34151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:34.922549 5439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:34.922830 5439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:34.922909 5439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:34.926873 5439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:34.926957 5439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:34.927052 5439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:26:34.932163 5439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:34151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:43519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:34.933215 5439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:34.934223 5439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:34.944797 5451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:34.944862 5445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:34.944895 5439 server_base.cc:1034] running on GCE node
W20260809 02:26:34.944813 5449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:34.945685 5439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:34.946405 5439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:34.947700 5439 hybrid_clock.cc:648] HybridClock initialized: now 1786242394947667 us; error 38 us; skew 500 ppm
Aug 09 02:26:34 dist-test-slave-68xk krb5kdc[5294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242394, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:34.950683 5439 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:26:34.951578 5439 webserver.cc:460] Webserver started at http://127.21.214.129:35259/ using document root <none> and password file <none>
I20260809 02:26:34.952163 5439 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:34.952260 5439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:34.952498 5439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:34.954623 5439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "7d2a325fc2184ef88cac38fb307115af"
format_stamp: "Formatted at 2026-08-09 02:26:34 on dist-test-slave-68xk"
server_key: "cc42d7be2087df0f1f37e9950c051fad"
server_key_iv: "67ac7a0720f23cbde617701d3dbc7b23"
server_key_version: "encryptionkey@0"
I20260809 02:26:34.955194 5439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "7d2a325fc2184ef88cac38fb307115af"
format_stamp: "Formatted at 2026-08-09 02:26:34 on dist-test-slave-68xk"
server_key: "cc42d7be2087df0f1f37e9950c051fad"
server_key_iv: "67ac7a0720f23cbde617701d3dbc7b23"
server_key_version: "encryptionkey@0"
I20260809 02:26:34.959270 5439 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:26:34.961745 5459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:34.962993 5439 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:26:34.963141 5439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "7d2a325fc2184ef88cac38fb307115af"
format_stamp: "Formatted at 2026-08-09 02:26:34 on dist-test-slave-68xk"
server_key: "cc42d7be2087df0f1f37e9950c051fad"
server_key_iv: "67ac7a0720f23cbde617701d3dbc7b23"
server_key_version: "encryptionkey@0"
I20260809 02:26:34.963254 5439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:34.974062 5439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:34.976842 5439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:34.977054 5439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:34.977648 5439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:34.978567 5439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:34.978636 5439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:34.978716 5439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:34.978760 5439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:34.989116 5439 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:38947
I20260809 02:26:34.989166 5601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:38947 every 8 connection(s)
I20260809 02:26:34.990037 5439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:26:34.999612 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 5439
I20260809 02:26:34.999748 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
Aug 09 02:26:34 dist-test-slave-68xk krb5kdc[5294](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242394, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:26:35.000105 22362 external_mini_cluster.cc:1428] Setting key e668fd940aadf525351dc3bf262f3587
I20260809 02:26:35.005548 5405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:34.991955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:52539 (local address 127.21.214.190:43519)
0809 02:26:34.992098 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:34.992102 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:34.992961 (+ 859us) server_negotiation.cc:407] Connection header received
0809 02:26:34.994403 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:34.994406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:34.994492 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:34.994585 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:34.995804 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:34.996352 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:34.997557 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:34.997806 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:34.997923 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.000637 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:35.000640 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:35.000642 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:35.000686 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:35.002646 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:35.003231 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:35.003238 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:35.003242 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:35.003344 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:35.003698 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:35.003703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:35.003708 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:35.003967 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:35.004086 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:35.004948 (+ 862us) server_negotiation.cc:299] Negotiation successful
0809 02:26:35.005203 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:26:35.006377 5606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:34.992319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:43519 (local address 127.21.214.129:52539)
0809 02:26:34.992805 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:34.992849 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:34.994186 (+ 1337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:34.994781 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:34.994788 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:34.995155 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:34.995641 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:34.995655 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:34.996494 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:34.996498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:34.997397 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:34.997407 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:34.997966 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:34.997970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:34.998140 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:34.998765 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:34.998782 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:35.000438 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:35.002811 (+ 2373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:35.002816 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:35.002829 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:35.003114 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:35.003453 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:35.003456 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:35.003457 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:35.003601 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:35.004127 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:35.004137 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:35.004494 (+ 357us) client_negotiation.cc:769] Sending connection context
0809 02:26:35.004813 (+ 319us) client_negotiation.cc:240] Negotiation successful
0809 02:26:35.005220 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":119,"threads_started":1}
I20260809 02:26:35.009220 5603 heartbeater.cc:347] Connected to a master server at 127.21.214.190:43519
I20260809 02:26:35.009490 5603 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:35.010185 5603 heartbeater.cc:511] Master 127.21.214.190:43519 requested a full tablet report, sending...
I20260809 02:26:35.012910 5359 ts_manager.cc:194] Registered new tserver with Master: 7d2a325fc2184ef88cac38fb307115af (127.21.214.129:38947)
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:26:35.014257 5359 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:52539
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:26:35.033767 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:43519
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:34151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:35.180621 5610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:35.180960 5610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:35.181046 5610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:35.185799 5610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:35.185868 5610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:35.185984 5610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:26:35.192375 5610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:34151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:43519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:35.193558 5610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:35.194746 5610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:35.205250 5618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:35.205243 5621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:35.205240 5617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:35.205487 5610 server_base.cc:1034] running on GCE node
I20260809 02:26:35.205997 5610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:35.206696 5610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:35.207902 5610 hybrid_clock.cc:648] HybridClock initialized: now 1786242395207881 us; error 31 us; skew 500 ppm
Aug 09 02:26:35 dist-test-slave-68xk krb5kdc[5294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242395, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:35.211136 5610 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:26:35.212102 5610 webserver.cc:460] Webserver started at http://127.21.214.130:36513/ using document root <none> and password file <none>
I20260809 02:26:35.212682 5610 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:35.212744 5610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:35.212961 5610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:35.215108 5610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "7dc3292a83954ea9a623eb99cd796824"
format_stamp: "Formatted at 2026-08-09 02:26:35 on dist-test-slave-68xk"
server_key: "1da586dd64b0bd3ebef0c9185bbbf438"
server_key_iv: "49142c737770d1dca6e00fb41740241d"
server_key_version: "encryptionkey@0"
I20260809 02:26:35.215689 5610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "7dc3292a83954ea9a623eb99cd796824"
format_stamp: "Formatted at 2026-08-09 02:26:35 on dist-test-slave-68xk"
server_key: "1da586dd64b0bd3ebef0c9185bbbf438"
server_key_iv: "49142c737770d1dca6e00fb41740241d"
server_key_version: "encryptionkey@0"
I20260809 02:26:35.219627 5610 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 02:26:35.222051 5629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:35.223397 5610 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:26:35.223536 5610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "7dc3292a83954ea9a623eb99cd796824"
format_stamp: "Formatted at 2026-08-09 02:26:35 on dist-test-slave-68xk"
server_key: "1da586dd64b0bd3ebef0c9185bbbf438"
server_key_iv: "49142c737770d1dca6e00fb41740241d"
server_key_version: "encryptionkey@0"
I20260809 02:26:35.223649 5610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:35.239797 5610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:35.244277 5610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:35.244529 5610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:35.245213 5610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:35.246148 5610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:35.246225 5610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:35.246289 5610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:35.246320 5610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:35.255565 5610 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:34387
I20260809 02:26:35.255599 5787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:34387 every 8 connection(s)
I20260809 02:26:35.256443 5610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:26:35.257833 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 5610
I20260809 02:26:35.257946 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:26:35.258276 22362 external_mini_cluster.cc:1428] Setting key 378facf74e9a971494dae3327191de12
Aug 09 02:26:35 dist-test-slave-68xk krb5kdc[5294](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242395, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
I20260809 02:26:35.273561 5405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.258486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:45273 (local address 127.21.214.190:43519)
0809 02:26:35.258655 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:35.258660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:35.259704 (+ 1044us) server_negotiation.cc:407] Connection header received
0809 02:26:35.261171 (+ 1467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:35.261174 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:35.261229 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:35.261317 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:35.262980 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.263606 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.265426 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.265756 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.265845 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.269396 (+ 3551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:35.269403 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:35.269408 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:35.269447 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:35.271047 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:35.271688 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:35.271691 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:35.271692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:35.271787 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:35.272161 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:35.272165 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:35.272166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:35.272357 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:35.272440 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:35.273080 (+ 640us) server_negotiation.cc:299] Negotiation successful
0809 02:26:35.273276 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:26:35.274296 5790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.259000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:43519 (local address 127.21.214.130:45273)
0809 02:26:35.259532 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:35.259594 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:35.260952 (+ 1358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:35.261503 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:35.261510 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:35.262034 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:35.262780 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.262804 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.263741 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.263747 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.265291 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.265307 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.265929 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.265934 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.266152 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.267342 (+ 1190us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:35.267362 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:35.269166 (+ 1804us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:35.271203 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:35.271212 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:35.271231 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:35.271514 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:35.271896 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:35.271900 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:35.271902 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:35.272052 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:35.272491 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:35.272501 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:35.272791 (+ 290us) client_negotiation.cc:769] Sending connection context
0809 02:26:35.272953 (+ 162us) client_negotiation.cc:240] Negotiation successful
0809 02:26:35.273319 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":120,"threads_started":1}
I20260809 02:26:35.275614 5788 heartbeater.cc:347] Connected to a master server at 127.21.214.190:43519
I20260809 02:26:35.275923 5788 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:35.276515 5788 heartbeater.cc:511] Master 127.21.214.190:43519 requested a full tablet report, sending...
I20260809 02:26:35.277791 5359 ts_manager.cc:194] Registered new tserver with Master: 7dc3292a83954ea9a623eb99cd796824 (127.21.214.130:34387)
I20260809 02:26:35.278851 5359 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:45273
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:26:35.293347 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:43519
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:34151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:26:35.417783 5794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:26:35.418226 5794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:26:35.418316 5794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:26:35.422828 5794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:26:35.422887 5794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:26:35.422948 5794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:26:35.428363 5794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:34151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:43519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:26:35.429354 5794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:26:35.430333 5794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:26:35.440598 5802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:35.440637 5800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:26:35.440624 5799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:26:35.440825 5794 server_base.cc:1034] running on GCE node
I20260809 02:26:35.441210 5794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:26:35.441871 5794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:26:35.443037 5794 hybrid_clock.cc:648] HybridClock initialized: now 1786242395443022 us; error 30 us; skew 500 ppm
Aug 09 02:26:35 dist-test-slave-68xk krb5kdc[5294](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242395, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:26:35.445868 5794 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:26:35.446949 5794 webserver.cc:460] Webserver started at http://127.21.214.131:38397/ using document root <none> and password file <none>
I20260809 02:26:35.447479 5794 fs_manager.cc:359] Metadata directory not provided
I20260809 02:26:35.447537 5794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:26:35.447715 5794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:26:35.450663 5794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "988c4685b4934e59a47812758b72ec4f"
format_stamp: "Formatted at 2026-08-09 02:26:35 on dist-test-slave-68xk"
server_key: "6fbc184552b81ce2191d35ca63444fb5"
server_key_iv: "71b9ea9c07e7e68f27bdcdce1e5455d2"
server_key_version: "encryptionkey@0"
I20260809 02:26:35.451200 5794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "988c4685b4934e59a47812758b72ec4f"
format_stamp: "Formatted at 2026-08-09 02:26:35 on dist-test-slave-68xk"
server_key: "6fbc184552b81ce2191d35ca63444fb5"
server_key_iv: "71b9ea9c07e7e68f27bdcdce1e5455d2"
server_key_version: "encryptionkey@0"
I20260809 02:26:35.454874 5794 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:26:35.457259 5813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:35.458642 5794 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:26:35.458813 5794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "988c4685b4934e59a47812758b72ec4f"
format_stamp: "Formatted at 2026-08-09 02:26:35 on dist-test-slave-68xk"
server_key: "6fbc184552b81ce2191d35ca63444fb5"
server_key_iv: "71b9ea9c07e7e68f27bdcdce1e5455d2"
server_key_version: "encryptionkey@0"
I20260809 02:26:35.458907 5794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:26:35.475674 5794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:26:35.478883 5794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:26:35.479095 5794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:26:35.479672 5794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:26:35.480492 5794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:26:35.480540 5794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:35.480578 5794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:26:35.480594 5794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:26:35.490501 5794 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:34701
I20260809 02:26:35.490550 5966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:34701 every 8 connection(s)
I20260809 02:26:35.491426 5794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:26:35.499569 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 5794
I20260809 02:26:35.499722 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:26:35.500088 22362 external_mini_cluster.cc:1428] Setting key 4596326f789236c833371fe0496e659f
Aug 09 02:26:35 dist-test-slave-68xk krb5kdc[5294](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242395, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:26:35.506318 5405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.493376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:47607 (local address 127.21.214.190:43519)
0809 02:26:35.493534 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:35.493538 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:35.494447 (+ 909us) server_negotiation.cc:407] Connection header received
0809 02:26:35.496314 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:35.496316 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:35.496364 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:35.496440 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:35.497628 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.498154 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.499430 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.499662 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.499824 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.502957 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:35.502960 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:35.502962 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:35.502987 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:35.504531 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:35.504995 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:35.504997 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:35.504998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:35.505086 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:35.505408 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:35.505410 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:35.505411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:35.505580 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:35.505675 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:35.506102 (+ 427us) server_negotiation.cc:299] Negotiation successful
0809 02:26:35.506201 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 02:26:35.507164 5969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.493707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:43519 (local address 127.21.214.131:47607)
0809 02:26:35.494236 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:35.494288 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:35.496015 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:35.496602 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:35.496608 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:35.496964 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:26:35.497486 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.497500 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.498269 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.498272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.499287 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.499297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.499859 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.499865 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.500095 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.500839 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:26:35.500861 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:26:35.502806 (+ 1945us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:26:35.504636 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:35.504640 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:35.504651 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:35.504899 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:35.505165 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:26:35.505167 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:26:35.505169 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:26:35.505320 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:26:35.505667 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:26:35.505671 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:26:35.505892 (+ 221us) client_negotiation.cc:769] Sending connection context
0809 02:26:35.506038 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 02:26:35.506326 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":140,"threads_started":1}
I20260809 02:26:35.508411 5967 heartbeater.cc:347] Connected to a master server at 127.21.214.190:43519
I20260809 02:26:35.508677 5967 heartbeater.cc:464] Registering TS with master...
I20260809 02:26:35.509176 5967 heartbeater.cc:511] Master 127.21.214.190:43519 requested a full tablet report, sending...
I20260809 02:26:35.510223 5359 ts_manager.cc:194] Registered new tserver with Master: 988c4685b4934e59a47812758b72ec4f (127.21.214.131:34701)
I20260809 02:26:35.510869 5359 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:47607
I20260809 02:26:35.514071 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:26:35.523603 5405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.516076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42142 (local address 127.21.214.190:43519)
0809 02:26:35.516253 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:35.516258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:35.516450 (+ 192us) server_negotiation.cc:407] Connection header received
0809 02:26:35.516584 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:35.516587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:35.516631 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:35.516721 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:26:35.517494 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.517991 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.518930 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.519144 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.519260 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.520591 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:26:35.520595 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:26:35.520598 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:26:35.520629 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:26:35.521840 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:35.522290 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:35.522294 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:35.522296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:35.522379 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:26:35.522715 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:26:35.522718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:26:35.522720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:26:35.522931 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:26:35.523079 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:35.523323 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 02:26:35.523437 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:26:35.526618 5359 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42142:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:26:35.529788 5359 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:26:35.544894 5988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.538837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:34701 (local address 127.0.0.1:37036)
0809 02:26:35.539640 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:35.539655 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:35.539760 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:35.540277 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:35.540283 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:35.540306 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:35.540487 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.540494 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.541731 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.541737 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.543455 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.543466 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.544319 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.544322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.544431 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.544471 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 02:26:35.544607 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 02:26:35.544738 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"mutex_wait_us":178,"thread_start_us":79,"threads_started":1}
I20260809 02:26:35.544912 5991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.539296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37036 (local address 127.21.214.131:34701)
0809 02:26:35.539787 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:35.539801 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:35.539827 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:26:35.539901 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:35.539932 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:35.540125 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:35.540281 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:35.540615 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.541588 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.543610 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.544181 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.544319 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.544454 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:35.544643 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 02:26:35.544740 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":102,"threads_started":1}
I20260809 02:26:35.545122 5989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.538816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41768 (local address 127.21.214.129:38947)
0809 02:26:35.539217 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:35.539225 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:35.540299 (+ 1074us) server_negotiation.cc:407] Connection header received
0809 02:26:35.540382 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:35.540388 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:35.540563 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:35.540719 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:35.540892 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.541990 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.543372 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.544193 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.544322 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.544458 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:35.544816 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 02:26:35.544920 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":144,"threads_started":1}
I20260809 02:26:35.545696 5987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.538621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60930 (local address 127.21.214.130:34387)
0809 02:26:35.539447 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:35.539460 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:35.539485 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:26:35.539744 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:35.539753 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:35.539971 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:35.540140 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:35.540657 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.541870 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.543590 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.544392 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.544512 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.544621 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:35.545419 (+ 798us) server_negotiation.cc:299] Negotiation successful
0809 02:26:35.545521 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":175,"threads_started":1}
I20260809 02:26:35.546101 5985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.538474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:34387 (local address 127.0.0.1:60930)
0809 02:26:35.539327 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:35.539379 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:35.539511 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:35.540349 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:35.540351 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:35.540369 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:35.540518 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.540524 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.542011 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.542014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.543455 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.543466 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.544680 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.544686 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.544793 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.544813 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:26:35.544876 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 02:26:35.544935 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"mutex_wait_us":175,"thread_start_us":76,"threads_started":1}
I20260809 02:26:35.546367 5990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.539178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:38947 (local address 127.0.0.1:41768)
0809 02:26:35.540088 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:35.540102 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:35.540202 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:35.540690 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:35.540693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:35.540712 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:35.540792 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.540798 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.542118 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.542122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.543241 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.543251 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.544526 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.544530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.544615 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.544645 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 02:26:35.544716 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:26:35.545896 (+ 1180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":832,"mutex_wait_us":1082,"thread_start_us":100,"threads_started":1}
I20260809 02:26:35.548139 5876 tablet_service.cc:1467] Processing CreateTablet for tablet 6d07f57071114c799f36e727952d5d25 (DEFAULT_TABLE table=test-table [id=a7dcb2ee872a486ebcb7c64ac2c4f140]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:35.548532 5518 tablet_service.cc:1467] Processing CreateTablet for tablet 6d07f57071114c799f36e727952d5d25 (DEFAULT_TABLE table=test-table [id=a7dcb2ee872a486ebcb7c64ac2c4f140]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:35.548883 5697 tablet_service.cc:1467] Processing CreateTablet for tablet 6d07f57071114c799f36e727952d5d25 (DEFAULT_TABLE table=test-table [id=a7dcb2ee872a486ebcb7c64ac2c4f140]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:26:35.549319 5876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d07f57071114c799f36e727952d5d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:35.549383 5518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d07f57071114c799f36e727952d5d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:35.549849 5697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d07f57071114c799f36e727952d5d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:26:35.555792 5992 tablet_bootstrap.cc:492] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af: Bootstrap starting.
I20260809 02:26:35.557394 5994 tablet_bootstrap.cc:492] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f: Bootstrap starting.
I20260809 02:26:35.558064 5992 tablet_bootstrap.cc:654] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:35.558786 5995 tablet_bootstrap.cc:492] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824: Bootstrap starting.
I20260809 02:26:35.559019 5992 log.cc:824] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:35.559350 5994 tablet_bootstrap.cc:654] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:35.560796 5994 log.cc:824] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:35.561378 5992 tablet_bootstrap.cc:492] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af: No bootstrap required, opened a new log
I20260809 02:26:35.561404 5995 tablet_bootstrap.cc:654] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824: Neither blocks nor log segments found. Creating new log.
I20260809 02:26:35.561594 5992 ts_tablet_manager.cc:1397] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:26:35.562269 5995 log.cc:824] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824: Log is configured to *not* fsync() on all Append() calls
I20260809 02:26:35.563098 5994 tablet_bootstrap.cc:492] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f: No bootstrap required, opened a new log
I20260809 02:26:35.563357 5994 ts_tablet_manager.cc:1397] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:26:35.564061 5995 tablet_bootstrap.cc:492] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824: No bootstrap required, opened a new log
I20260809 02:26:35.564260 5995 ts_tablet_manager.cc:1397] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:26:35.566781 5992 raft_consensus.cc:348] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc3292a83954ea9a623eb99cd796824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 34387 } } peers { permanent_uuid: "7d2a325fc2184ef88cac38fb307115af" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 38947 } } peers { permanent_uuid: "988c4685b4934e59a47812758b72ec4f" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34701 } }
I20260809 02:26:35.567070 5992 raft_consensus.cc:374] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:35.567126 5992 raft_consensus.cc:729] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2a325fc2184ef88cac38fb307115af, State: Initialized, Role: FOLLOWER
I20260809 02:26:35.567631 5992 consensus_queue.cc:260] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc3292a83954ea9a623eb99cd796824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 34387 } } peers { permanent_uuid: "7d2a325fc2184ef88cac38fb307115af" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 38947 } } peers { permanent_uuid: "988c4685b4934e59a47812758b72ec4f" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34701 } }
I20260809 02:26:35.567678 5994 raft_consensus.cc:348] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc3292a83954ea9a623eb99cd796824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 34387 } } peers { permanent_uuid: "7d2a325fc2184ef88cac38fb307115af" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 38947 } } peers { permanent_uuid: "988c4685b4934e59a47812758b72ec4f" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34701 } }
I20260809 02:26:35.567731 5995 raft_consensus.cc:348] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc3292a83954ea9a623eb99cd796824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 34387 } } peers { permanent_uuid: "7d2a325fc2184ef88cac38fb307115af" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 38947 } } peers { permanent_uuid: "988c4685b4934e59a47812758b72ec4f" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34701 } }
I20260809 02:26:35.567945 5994 raft_consensus.cc:374] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:35.568008 5994 raft_consensus.cc:729] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 988c4685b4934e59a47812758b72ec4f, State: Initialized, Role: FOLLOWER
I20260809 02:26:35.568013 5995 raft_consensus.cc:374] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:26:35.568074 5995 raft_consensus.cc:729] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc3292a83954ea9a623eb99cd796824, State: Initialized, Role: FOLLOWER
I20260809 02:26:35.568449 5994 consensus_queue.cc:260] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc3292a83954ea9a623eb99cd796824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 34387 } } peers { permanent_uuid: "7d2a325fc2184ef88cac38fb307115af" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 38947 } } peers { permanent_uuid: "988c4685b4934e59a47812758b72ec4f" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34701 } }
I20260809 02:26:35.568550 5603 heartbeater.cc:503] Master 127.21.214.190:43519 was elected leader, sending a full tablet report...
I20260809 02:26:35.568727 5992 ts_tablet_manager.cc:1428] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260809 02:26:35.569212 5967 heartbeater.cc:503] Master 127.21.214.190:43519 was elected leader, sending a full tablet report...
I20260809 02:26:35.569373 5994 ts_tablet_manager.cc:1428] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:26:35.569702 5995 consensus_queue.cc:260] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc3292a83954ea9a623eb99cd796824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 34387 } } peers { permanent_uuid: "7d2a325fc2184ef88cac38fb307115af" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 38947 } } peers { permanent_uuid: "988c4685b4934e59a47812758b72ec4f" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34701 } }
I20260809 02:26:35.570645 5995 ts_tablet_manager.cc:1428] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:26:35.571347 5788 heartbeater.cc:503] Master 127.21.214.190:43519 was elected leader, sending a full tablet report...
I20260809 02:26:35.602180 6000 raft_consensus.cc:482] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:26:35.602512 6000 raft_consensus.cc:504] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc3292a83954ea9a623eb99cd796824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 34387 } } peers { permanent_uuid: "7d2a325fc2184ef88cac38fb307115af" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 38947 } } peers { permanent_uuid: "988c4685b4934e59a47812758b72ec4f" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34701 } }
I20260809 02:26:35.603965 6000 leader_election.cc:288] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dc3292a83954ea9a623eb99cd796824 (127.21.214.130:34387), 988c4685b4934e59a47812758b72ec4f (127.21.214.131:34701)
I20260809 02:26:35.608192 5991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.604449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:53745 (local address 127.21.214.131:34701)
0809 02:26:35.604586 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:35.604591 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:35.604801 (+ 210us) server_negotiation.cc:407] Connection header received
0809 02:26:35.604943 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:35.604946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:35.605000 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:35.605091 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:35.605437 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.605948 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.607208 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.607607 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.607738 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.607793 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:35.607982 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 02:26:35.608052 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:26:35.608234 5987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.604354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:41245 (local address 127.21.214.130:34387)
0809 02:26:35.604601 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:35.604605 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:35.604877 (+ 272us) server_negotiation.cc:407] Connection header received
0809 02:26:35.605045 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:35.605048 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:35.605093 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:35.605175 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:26:35.605555 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.606049 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.607222 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.607635 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.607789 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.607845 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:35.608032 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 02:26:35.608105 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151}
I20260809 02:26:35.608266 6007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.604242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:34701 (local address 127.21.214.129:53745)
0809 02:26:35.604690 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:35.604703 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:35.604846 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:35.605113 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:35.605116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:35.605133 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:35.605305 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.605311 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.606067 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.606071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.607071 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.607088 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.607735 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.607738 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.607842 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.607865 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:26:35.607964 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 02:26:35.608045 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"mutex_wait_us":21,"thread_start_us":133,"threads_started":1}
I20260809 02:26:35.608291 6008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.604263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:34387 (local address 127.21.214.129:41245)
0809 02:26:35.604780 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:35.604792 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:26:35.604918 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:26:35.605196 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:26:35.605199 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:26:35.605214 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:26:35.605434 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.605440 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.606164 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.606168 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.607096 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:26:35.607106 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.607789 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.607793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:26:35.607907 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.607925 (+ 18us) client_negotiation.cc:769] Sending connection context
0809 02:26:35.608016 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 02:26:35.608084 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":51,"thread_start_us":114,"threads_started":1}
I20260809 02:26:35.608954 5723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d07f57071114c799f36e727952d5d25" candidate_uuid: "7d2a325fc2184ef88cac38fb307115af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc3292a83954ea9a623eb99cd796824" is_pre_election: true
I20260809 02:26:35.608948 5902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d07f57071114c799f36e727952d5d25" candidate_uuid: "7d2a325fc2184ef88cac38fb307115af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "988c4685b4934e59a47812758b72ec4f" is_pre_election: true
I20260809 02:26:35.609256 5723 raft_consensus.cc:2454] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2a325fc2184ef88cac38fb307115af in term 0.
I20260809 02:26:35.609263 5902 raft_consensus.cc:2454] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2a325fc2184ef88cac38fb307115af in term 0.
I20260809 02:26:35.609776 5462 leader_election.cc:302] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2a325fc2184ef88cac38fb307115af, 7dc3292a83954ea9a623eb99cd796824; no voters:
I20260809 02:26:35.610073 6000 raft_consensus.cc:2781] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:26:35.610165 6000 raft_consensus.cc:482] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:26:35.610210 6000 raft_consensus.cc:3037] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:35.611351 6000 raft_consensus.cc:504] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc3292a83954ea9a623eb99cd796824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 34387 } } peers { permanent_uuid: "7d2a325fc2184ef88cac38fb307115af" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 38947 } } peers { permanent_uuid: "988c4685b4934e59a47812758b72ec4f" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34701 } }
I20260809 02:26:35.611730 6000 leader_election.cc:288] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [CANDIDATE]: Term 1 election: Requested vote from peers 7dc3292a83954ea9a623eb99cd796824 (127.21.214.130:34387), 988c4685b4934e59a47812758b72ec4f (127.21.214.131:34701)
I20260809 02:26:35.612061 5723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d07f57071114c799f36e727952d5d25" candidate_uuid: "7d2a325fc2184ef88cac38fb307115af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc3292a83954ea9a623eb99cd796824"
I20260809 02:26:35.612118 5902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d07f57071114c799f36e727952d5d25" candidate_uuid: "7d2a325fc2184ef88cac38fb307115af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "988c4685b4934e59a47812758b72ec4f"
I20260809 02:26:35.612181 5723 raft_consensus.cc:3037] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:35.612263 5902 raft_consensus.cc:3037] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:26:35.613317 5723 raft_consensus.cc:2454] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2a325fc2184ef88cac38fb307115af in term 1.
I20260809 02:26:35.613560 5902 raft_consensus.cc:2454] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2a325fc2184ef88cac38fb307115af in term 1.
I20260809 02:26:35.613662 5462 leader_election.cc:302] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d2a325fc2184ef88cac38fb307115af, 7dc3292a83954ea9a623eb99cd796824; no voters:
I20260809 02:26:35.613870 6000 raft_consensus.cc:2781] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:26:35.614090 6000 raft_consensus.cc:686] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [term 1 LEADER]: Becoming Leader. State: Replica: 7d2a325fc2184ef88cac38fb307115af, State: Running, Role: LEADER
I20260809 02:26:35.614502 6000 consensus_queue.cc:237] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc3292a83954ea9a623eb99cd796824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 34387 } } peers { permanent_uuid: "7d2a325fc2184ef88cac38fb307115af" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 38947 } } peers { permanent_uuid: "988c4685b4934e59a47812758b72ec4f" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34701 } }
I20260809 02:26:35.617875 5359 catalog_manager.cc:5495] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2a325fc2184ef88cac38fb307115af (127.21.214.129). New cstate: current_term: 1 leader_uuid: "7d2a325fc2184ef88cac38fb307115af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc3292a83954ea9a623eb99cd796824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 34387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2a325fc2184ef88cac38fb307115af" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 38947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "988c4685b4934e59a47812758b72ec4f" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34701 } health_report { overall_health: UNKNOWN } } }
I20260809 02:26:35.642023 5989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.638295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41776 (local address 127.21.214.129:38947)
0809 02:26:35.638460 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 02:26:35.638465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:26:35.638485 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:26:35.638613 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:26:35.638615 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:26:35.638671 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:26:35.638759 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:26:35.639025 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.639610 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.640544 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:26:35.640767 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:26:35.640847 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:26:35.641135 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:26:35.641570 (+ 435us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:26:35.641664 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:26:35.641781 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 02:26:35.641836 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 02:26:35.648360 5723 raft_consensus.cc:1261] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824 [term 1 FOLLOWER]: Refusing update from remote peer 7d2a325fc2184ef88cac38fb307115af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:35.648366 5902 raft_consensus.cc:1261] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f [term 1 FOLLOWER]: Refusing update from remote peer 7d2a325fc2184ef88cac38fb307115af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:26:35.649134 6009 consensus_queue.cc:1035] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc3292a83954ea9a623eb99cd796824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 34387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:35.649319 6000 consensus_queue.cc:1035] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [LEADER]: Connected to new peer: Peer: permanent_uuid: "988c4685b4934e59a47812758b72ec4f" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 34701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:26:35.656102 6012 mvcc.cc:205] Tried to move back new op lower bound from 7316448852567556096 to 7316448852439814144. Current Snapshot: MvccSnapshot[applied={T|T < 7316448852567556096}]
I20260809 02:26:35.656291 6014 mvcc.cc:205] Tried to move back new op lower bound from 7316448852567556096 to 7316448852439814144. Current Snapshot: MvccSnapshot[applied={T|T < 7316448852567556096}]
I20260809 02:26:35.666853 5356 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:35.667001 5356 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:26:35.669371 5356 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bd4edf1f293549e181f9e674707ef364: Sending DeleteTablet for 3 replicas of tablet 6d07f57071114c799f36e727952d5d25
I20260809 02:26:35.670158 5876 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d07f57071114c799f36e727952d5d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:35 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:37036
I20260809 02:26:35.670156 5697 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d07f57071114c799f36e727952d5d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:35 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:60930
I20260809 02:26:35.670234 5518 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d07f57071114c799f36e727952d5d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:26:35 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:41768
I20260809 02:26:35.670786 6026 tablet_replica.cc:330] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af: stopping tablet replica
I20260809 02:26:35.671165 6026 raft_consensus.cc:2229] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:26:35.671517 6026 raft_consensus.cc:2258] T 6d07f57071114c799f36e727952d5d25 P 7d2a325fc2184ef88cac38fb307115af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:35.671665 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 5439
I20260809 02:26:35.671914 6023 tablet_replica.cc:330] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f: stopping tablet replica
I20260809 02:26:35.672371 6023 raft_consensus.cc:2229] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:35.672739 6023 raft_consensus.cc:2258] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:35.673151 6025 tablet_replica.cc:330] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824: stopping tablet replica
I20260809 02:26:35.673509 6025 raft_consensus.cc:2229] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:26:35.673831 6025 raft_consensus.cc:2258] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:26:35.677356 6023 ts_tablet_manager.cc:1905] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:35.680187 6025 ts_tablet_manager.cc:1905] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:26:35.681879 6023 ts_tablet_manager.cc:1918] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:26:35.682003 6023 log.cc:1196] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/6d07f57071114c799f36e727952d5d25
I20260809 02:26:35.682401 6023 ts_tablet_manager.cc:1939] T 6d07f57071114c799f36e727952d5d25 P 988c4685b4934e59a47812758b72ec4f: Deleting consensus metadata
I20260809 02:26:35.682725 6025 ts_tablet_manager.cc:1918] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:26:35.682844 6025 log.cc:1196] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/6d07f57071114c799f36e727952d5d25
I20260809 02:26:35.683159 6025 ts_tablet_manager.cc:1939] T 6d07f57071114c799f36e727952d5d25 P 7dc3292a83954ea9a623eb99cd796824: Deleting consensus metadata
I20260809 02:26:35.683977 5338 catalog_manager.cc:4841] TS 988c4685b4934e59a47812758b72ec4f (127.21.214.131:34701): tablet 6d07f57071114c799f36e727952d5d25 (table test-table [id=a7dcb2ee872a486ebcb7c64ac2c4f140]) successfully deleted
I20260809 02:26:35.684327 5336 catalog_manager.cc:4841] TS 7dc3292a83954ea9a623eb99cd796824 (127.21.214.130:34387): tablet 6d07f57071114c799f36e727952d5d25 (table test-table [id=a7dcb2ee872a486ebcb7c64ac2c4f140]) successfully deleted
W20260809 02:26:35.688577 5335 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:38947 (error 108)
I20260809 02:26:35.689563 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 5610
I20260809 02:26:35.689778 5988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:26:35.689423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:38947 (local address 127.0.0.1:41778)
0809 02:26:35.689583 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 02:26:35.689674 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:38947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260809 02:26:35.693428 5335 catalog_manager.cc:4584] TS 7d2a325fc2184ef88cac38fb307115af (127.21.214.129:38947): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6d07f57071114c799f36e727952d5d25: Network error: Client connection negotiation failed: client connection to 127.21.214.129:38947: connect: Connection refused (error 111)
I20260809 02:26:35.700269 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 5794
I20260809 02:26:35.709405 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 5310
2026-08-09T02:26:35Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2614 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:26:35 dist-test-slave-68xk krb5kdc[6031](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:26:35 dist-test-slave-68xk krb5kdc[6031](info): set up 2 sockets
Aug 09 02:26:35 dist-test-slave-68xk krb5kdc[6031](info): commencing operation
krb5kdc: starting...
W20260809 02:26:37.023983 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:26:37 dist-test-slave-68xk krb5kdc[6031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242397, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:26:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:26:37Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.21.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.21.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/rangeradmin_127.21.214.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/rangeradmin_127.21.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.21.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.21.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/rangerlookup_127.21.214.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/rangerlookup_127.21.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.21.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.21.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/HTTP_127.21.214.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/HTTP_127.21.214.148@KRBTEST.COM.keytab.
I20260809 02:26:37.213068 22362 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskplQfV_/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/postgres -l logfile start
2026-08-09 02:26:39.870 UTC [6072] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 02:26:39.870 UTC [6072] LOG: listening on IPv4 address "127.21.214.148", port 40537
2026-08-09 02:26:39.874 UTC [6072] LOG: listening on Unix socket "/tmp/.s.PGSQL.40537"
2026-08-09 02:26:39.914 UTC [6075] LOG: database system was shut down at 2026-08-09 02:26:38 UTC
2026-08-09 02:26:39.919 UTC [6072] LOG: database system is ready to accept connections
I20260809 02:26:41.084667 22362 mini_postgres.cc:96] Postgres bound to 40537
2026-08-09 02:26:41.092 UTC [6088] FATAL: database "slave" does not exist
127.21.214.148:40537 - accepting connections
I20260809 02:26:41.093327 22362 mini_ranger.cc:161] Starting Ranger...
I20260809 02:26:41.109788 22362 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 02:26:41.636449 22362 mini_ranger.cc:87] Created ranger Postgres database
I20260809 02:26:41.636531 22362 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-admin
2026-08-09 02:26:41,937 [I] DB FLAVOR :POSTGRES
2026-08-09 02:26:41,938 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 02:26:41,938 [I] Checking connection..
2026-08-09 02:26:41,938 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 02:26:42,210 [I] Checking connection passed.
2026-08-09 02:26:42,211 [I] --------- Verifying version history table ---------
2026-08-09 02:26:42,211 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:26:42,463 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 02:26:42,464 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:26:42,719 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 02:26:42,719 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 02:26:42,719 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 02:26:42.963 UTC [6171] WARNING: there is no transaction in progress
2026-08-09 02:26:42,972 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 02:26:42,973 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:26:43,235 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 02:26:43,235 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 02:26:43,235 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 02:26:43,488 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 02:26:43,772 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-68xk.c.gcp-upstream.internal','N') ;"
2026-08-09 02:26:44,038 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 02:26:44,287 [I] Table x_portal_user does not exist in database ranger
2026-08-09 02:26:44,287 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 02:26:44,567 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 02:26:44,567 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 02:26:44,833 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 02:26:45,104 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 02:26:45,104 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 02:26:46.148 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.165 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.181 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.196 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.215 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.236 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.304 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.310 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.324 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.335 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.345 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.358 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.368 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.375 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.382 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:46.388 UTC [6325] WARNING: there is no transaction in progress
2026-08-09 02:26:47,094 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 02:26:47,094 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 02:26:47,349 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 02:26:47,349 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 02:26:47,613 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 02:26:47,613 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 02:26:47,856 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 02:26:47,857 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 02:26:48,103 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 02:26:48,373 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-68xk.c.gcp-upstream.internal';"
2026-08-09 02:26:48,625 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 02:26:48,625 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 02:26:48,870 [I] DB_PATCHES have already been applied
I20260809 02:26:48.876466 22362 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-admin:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskplQfV_/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 02:26:48.876565 22362 mini_ranger.cc:193] Using host: 127.21.214.148
I20260809 02:26:48.881085 22362 mini_ranger.cc:227] Ranger admin URL: http://127.21.214.148:60363
Aug 09, 2026 2:26:49 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 2:26:49 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 2:26:49 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 2:26:49 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 2:26:49 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 2:26:49 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 2:26:49 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 02:26:50.261778 22362 mini_ranger.cc:160] Time spent starting Ranger: real 9.168s user 0.000s sys 0.013s
Aug 09, 2026 2:27:11 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 2:27:11 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 2:27:11 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 2:27:11 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 2:27:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 2:27:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 2:27:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 2:27:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 2:27:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 2:27:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 2:27:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 2:27:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 2:27:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 2:27:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 2:27:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 2:27:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 2:27:11 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 2:27:12 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 02:27:13.401940 22362 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.21.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.21.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/rangerkms_127.21.214.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/rangerkms_127.21.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.21.214.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.21.214.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.21.214.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/HTTP_127.21.214.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.21.214.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/HTTP_127.21.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 02:27:13 dist-test-slave-68xk krb5kdc[6031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242433, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 02:27:13.500154 22362 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 02:27:13.512555 22362 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 02:27:14.478055 22362 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 02:27:14.478181 22362 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-kms
I20260809 02:27:14.478300 22362 mini_ranger_kms.cc:227] Using postgres at 127.21.214.148:40537
2026-08-09 02:27:14,747 [I] DB FLAVOR :POSTGRES
2026-08-09 02:27:14,747 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 02:27:14,747 [I] Checking connection
2026-08-09 02:27:14,748 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 02:27:14,998 [I] connection success
2026-08-09 02:27:14,998 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 02:27:14,998 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 02:27:14,998 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 02:27:15,248 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 02:27:15,248 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 02:27:15,248 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 02:27:15,248 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:40537/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 02:27:15,518 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 02:27:16.107712 22362 mini_ranger_kms.cc:310] Created kms service
I20260809 02:27:16.307436 22362 mini_ranger_kms.cc:326] Created kudu user
I20260809 02:27:16.357084 22362 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 02:27:16 dist-test-slave-68xk krb5kdc[6031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242433, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:27:16.790904 22362 mini_ranger_kms.cc:384] Added ranger policy
I20260809 02:27:16.791301 22362 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-kms:/tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 02:27:16.791338 22362 mini_ranger_kms.cc:240] Using host: 127.21.214.148
I20260809 02:27:16.796921 22362 mini_ranger_kms.cc:276] Ranger KMS PID: 6573
I20260809 02:27:16.797060 22362 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.21.214.148:37465
Aug 09, 2026 2:27:17 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 2:27:17 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 2:27:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 2:27:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 2:27:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 2:27:18 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 02:27:19 dist-test-slave-68xk krb5kdc[6031](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242439, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.214.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:27:19.535561 22362 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.035s user 0.006s sys 0.245s
I20260809 02:27:19.535720 22362 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 02:27:19.535836 22362 mini_ranger_kms.cc:401] 127.21.214.148:37465/kms/v1/keys
Aug 09 02:27:19 dist-test-slave-68xk krb5kdc[6031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242439, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.214.148@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
Aug 09 02:27:20 dist-test-slave-68xk krb5kdc[6031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242439, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.214.148@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
Aug 09 02:27:22 dist-test-slave-68xk krb5kdc[6031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:27:22.579905 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:42413
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:42413
--ranger_config_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.214.148:37465/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:27:22.702280 6638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:27:22.702653 6638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:27:22.702757 6638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:27:22.707619 6638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:27:22.707708 6638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:27:22.707742 6638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:27:22.707785 6638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:27:22.707931 6638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:27:22.714289 6638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/wal
--ranger_kms_url=127.21.214.148:37465/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:42413
--ranger_config_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:42413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:27:22.715453 6638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:27:22.716639 6638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:27:22.726253 6644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:27:22.726377 6638 server_base.cc:1034] running on GCE node
W20260809 02:27:22.726274 6645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:27:22.726676 6648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:27:22.727450 6638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:27:22.728767 6638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:27:22.729977 6638 hybrid_clock.cc:648] HybridClock initialized: now 1786242442729929 us; error 66 us; skew 500 ppm
Aug 09 02:27:22 dist-test-slave-68xk krb5kdc[6031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242442, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:27:22.739120 6638 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:27:22.740285 6638 webserver.cc:460] Webserver started at http://127.21.214.190:35209/ using document root <none> and password file <none>
I20260809 02:27:22.740916 6638 fs_manager.cc:359] Metadata directory not provided
I20260809 02:27:22.741004 6638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:27:22.741271 6638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:27:22 dist-test-slave-68xk krb5kdc[6031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242442, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:27:22.795181 6638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "83bc97bb06b6465f9cb4990a527801d9"
format_stamp: "Formatted at 2026-08-09 02:27:22 on dist-test-slave-68xk"
server_key: "c75b0529f9d39a767090f0b246f15bb6"
server_key_iv: "042f824fe3ff81b8e0a36b6de2f4d99a"
server_key_version: "kuduclusterkey@0"
I20260809 02:27:22.795953 6638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "83bc97bb06b6465f9cb4990a527801d9"
format_stamp: "Formatted at 2026-08-09 02:27:22 on dist-test-slave-68xk"
server_key: "c75b0529f9d39a767090f0b246f15bb6"
server_key_iv: "042f824fe3ff81b8e0a36b6de2f4d99a"
server_key_version: "kuduclusterkey@0"
I20260809 02:27:22.800479 6638 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:27:22.819003 6659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:27:22.820791 6638 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 02:27:22.820953 6638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "83bc97bb06b6465f9cb4990a527801d9"
format_stamp: "Formatted at 2026-08-09 02:27:22 on dist-test-slave-68xk"
server_key: "c75b0529f9d39a767090f0b246f15bb6"
server_key_iv: "042f824fe3ff81b8e0a36b6de2f4d99a"
server_key_version: "kuduclusterkey@0"
I20260809 02:27:22.821126 6638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:27:22.839107 6638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:27:22.842474 6638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:27:22.842680 6638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:27:22.851881 6638 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:42413
I20260809 02:27:22.851887 6730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:42413 every 8 connection(s)
I20260809 02:27:22.853129 6638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:27:22.856609 6731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:27:22.859617 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 6638
I20260809 02:27:22.859760 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:27:22.860111 22362 external_mini_cluster.cc:1428] Setting key ed712f03d3f9b05c5abada986cdb719c
I20260809 02:27:22.863652 6731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9: Bootstrap starting.
I20260809 02:27:22.866472 6731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9: Neither blocks nor log segments found. Creating new log.
I20260809 02:27:22.867476 6731 log.cc:824] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9: Log is configured to *not* fsync() on all Append() calls
I20260809 02:27:22.869874 6731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9: No bootstrap required, opened a new log
Aug 09 02:27:22 dist-test-slave-68xk krb5kdc[6031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:27:22.874929 6731 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83bc97bb06b6465f9cb4990a527801d9" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42413 } }
I20260809 02:27:22.875187 6731 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:27:22.875269 6731 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83bc97bb06b6465f9cb4990a527801d9, State: Initialized, Role: FOLLOWER
I20260809 02:27:22.875823 6731 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83bc97bb06b6465f9cb4990a527801d9" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42413 } }
I20260809 02:27:22.876031 6731 raft_consensus.cc:388] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:27:22.876147 6731 raft_consensus.cc:482] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:27:22.876283 6731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:27:22.877496 6731 raft_consensus.cc:504] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83bc97bb06b6465f9cb4990a527801d9" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42413 } }
I20260809 02:27:22.877874 6731 leader_election.cc:302] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83bc97bb06b6465f9cb4990a527801d9; no voters:
I20260809 02:27:22.878250 6731 leader_election.cc:288] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:27:22.878459 6735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:22.861746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58564 (local address 127.21.214.190:42413)
0809 02:27:22.862256 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0809 02:27:22.862276 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:27:22.862331 (+ 55us) server_negotiation.cc:407] Connection header received
0809 02:27:22.863206 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:27:22.863231 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:27:22.863663 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:27:22.864021 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:27:22.865030 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:22.866587 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:22.867870 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:22.868584 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:22.868739 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:22.872307 (+ 3568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:27:22.872314 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:27:22.872332 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:27:22.872364 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:27:22.874761 (+ 2397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:27:22.875364 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:27:22.875371 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:27:22.875377 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:27:22.875516 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:27:22.875902 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:27:22.875905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:27:22.875907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:27:22.876433 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:27:22.876632 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 02:27:22.876982 (+ 350us) server_negotiation.cc:299] Negotiation successful
0809 02:27:22.877449 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":149,"threads_started":1}
I20260809 02:27:22.878327 6737 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:27:22.878976 6737 raft_consensus.cc:686] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [term 1 LEADER]: Becoming Leader. State: Replica: 83bc97bb06b6465f9cb4990a527801d9, State: Running, Role: LEADER
I20260809 02:27:22.879374 6737 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83bc97bb06b6465f9cb4990a527801d9" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42413 } }
I20260809 02:27:22.880086 6731 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:27:22.882018 6737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83bc97bb06b6465f9cb4990a527801d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83bc97bb06b6465f9cb4990a527801d9" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42413 } } }
I20260809 02:27:22.882275 6737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [sys.catalog]: This master's current role is: LEADER
I20260809 02:27:22.882622 6737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83bc97bb06b6465f9cb4990a527801d9. Latest consensus state: current_term: 1 leader_uuid: "83bc97bb06b6465f9cb4990a527801d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83bc97bb06b6465f9cb4990a527801d9" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42413 } } }
I20260809 02:27:22.882792 6756 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:27:22.882908 6731 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 02:27:22.882803 6737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9 [sys.catalog]: This master's current role is: LEADER
I20260809 02:27:22.891672 6756 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:27:22.901341 6756 catalog_manager.cc:1347] Generated new cluster ID: 1ba152b0a7cd4808953b32f978eeee03
I20260809 02:27:22.901489 6756 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:27:22.933904 6756 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:27:22.935451 6756 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:27:22.946990 6756 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9: Generated new TSK 0
I20260809 02:27:22.948030 6756 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:27:23.769151 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.214.148:37465/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42413
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:27:23.942287 6791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:27:23.942659 6791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:27:23.942725 6791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:27:23.948856 6791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:27:23.948946 6791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:27:23.949041 6791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:27:23.957310 6791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.21.214.148:37465/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:27:23.958827 6791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:27:23.960283 6791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:27:23.973613 6798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:27:23.973618 6799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:27:23.973857 6801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:27:23.974926 6791 server_base.cc:1034] running on GCE node
I20260809 02:27:23.975409 6791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:27:23.976224 6791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:27:23.977425 6791 hybrid_clock.cc:648] HybridClock initialized: now 1786242443977394 us; error 46 us; skew 500 ppm
Aug 09 02:27:23 dist-test-slave-68xk krb5kdc[6031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242443, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:27:23.981338 6791 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:27:23.982484 6791 webserver.cc:460] Webserver started at http://127.21.214.129:46799/ using document root <none> and password file <none>
I20260809 02:27:23.983289 6791 fs_manager.cc:359] Metadata directory not provided
I20260809 02:27:23.983392 6791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:27:23.983704 6791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:27:23 dist-test-slave-68xk krb5kdc[6031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242443, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:27:24.000447 6791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "dbd8c15921bd447ca20d9bc7047bb4d6"
format_stamp: "Formatted at 2026-08-09 02:27:23 on dist-test-slave-68xk"
server_key: "34c4a651cc7abbcee52161ba58bf82c0"
server_key_iv: "06e21817d62b488f2c2bcd595254989d"
server_key_version: "kuduclusterkey@0"
I20260809 02:27:24.001250 6791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "dbd8c15921bd447ca20d9bc7047bb4d6"
format_stamp: "Formatted at 2026-08-09 02:27:23 on dist-test-slave-68xk"
server_key: "34c4a651cc7abbcee52161ba58bf82c0"
server_key_iv: "06e21817d62b488f2c2bcd595254989d"
server_key_version: "kuduclusterkey@0"
I20260809 02:27:24.007936 6791 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260809 02:27:24.034814 6810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:27:24.036546 6791 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.002s sys 0.001s
I20260809 02:27:24.036701 6791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "dbd8c15921bd447ca20d9bc7047bb4d6"
format_stamp: "Formatted at 2026-08-09 02:27:23 on dist-test-slave-68xk"
server_key: "34c4a651cc7abbcee52161ba58bf82c0"
server_key_iv: "06e21817d62b488f2c2bcd595254989d"
server_key_version: "kuduclusterkey@0"
I20260809 02:27:24.036839 6791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:27:24.060477 6791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:27:24.064289 6791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:27:24.064548 6791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:27:24.065333 6791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:27:24.066471 6791 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:27:24.066583 6791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:27:24.066723 6791 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:27:24.066814 6791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:27:24.080958 6791 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:43879
I20260809 02:27:24.081044 6961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:43879 every 8 connection(s)
I20260809 02:27:24.082304 6791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:27:24.090459 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 6791
I20260809 02:27:24.090597 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:27:24.090955 22362 external_mini_cluster.cc:1428] Setting key 1eee8c7be65091e4cf0b4b907295a8ea
Aug 09 02:27:24 dist-test-slave-68xk krb5kdc[6031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242443, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:27:24.101099 6965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:24.085032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:42413 (local address 127.21.214.129:38245)
0809 02:27:24.085533 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0809 02:27:24.085587 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 02:27:24.086708 (+ 1121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:27:24.087370 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:27:24.087379 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:27:24.087759 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:27:24.088409 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:24.088428 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.089587 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.089591 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:24.091053 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:24.091065 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.092090 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.092094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:24.092292 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:24.093035 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:27:24.093057 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:27:24.095065 (+ 2008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:27:24.097540 (+ 2475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:27:24.097547 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:27:24.097563 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:27:24.097931 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:27:24.098302 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:27:24.098305 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:27:24.098307 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:27:24.098516 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:27:24.099064 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:27:24.099071 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:27:24.099411 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 02:27:24.099638 (+ 227us) client_negotiation.cc:240] Negotiation successful
0809 02:27:24.099986 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":144,"threads_started":1}
I20260809 02:27:24.101910 6964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:24.084609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:38245 (local address 127.21.214.190:42413)
0809 02:27:24.084904 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0809 02:27:24.084909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:27:24.085714 (+ 805us) server_negotiation.cc:407] Connection header received
0809 02:27:24.086967 (+ 1253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:27:24.086972 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:27:24.087035 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:27:24.087166 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:27:24.088586 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.089436 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.091203 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.091800 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.091885 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:24.095288 (+ 3403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:27:24.095292 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:27:24.095294 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:27:24.095321 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:27:24.097401 (+ 2080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:27:24.098072 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:27:24.098076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:27:24.098078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:27:24.098193 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:27:24.098642 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:27:24.098648 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:27:24.098650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:27:24.098898 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:27:24.099003 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 02:27:24.101586 (+ 2583us) server_negotiation.cc:299] Negotiation successful
0809 02:27:24.101728 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":86,"threads_started":1}
I20260809 02:27:24.103227 6962 heartbeater.cc:347] Connected to a master server at 127.21.214.190:42413
I20260809 02:27:24.103485 6962 heartbeater.cc:464] Registering TS with master...
I20260809 02:27:24.104038 6962 heartbeater.cc:511] Master 127.21.214.190:42413 requested a full tablet report, sending...
I20260809 02:27:24.105949 6682 ts_manager.cc:194] Registered new tserver with Master: dbd8c15921bd447ca20d9bc7047bb4d6 (127.21.214.129:43879)
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:27:24.107617 6682 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:38245
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:27:24.127846 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.214.148:37465/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42413
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:27:24 dist-test-slave-68xk krb5kdc[6031](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242444, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 02:27:24.296200 6970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:27:24.296613 6970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:27:24.296756 6970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:27:24.303618 6970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:27:24.303709 6970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:27:24.303825 6970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:27:24.312732 6970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.21.214.148:37465/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:27:24.314451 6970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:27:24.316061 6970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:27:24.330606 6983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:27:24.333173 6977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:27:24.333487 6978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:27:24.334528 6970 server_base.cc:1034] running on GCE node
I20260809 02:27:24.335225 6970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:27:24.336102 6970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:27:24.337284 6970 hybrid_clock.cc:648] HybridClock initialized: now 1786242444337239 us; error 64 us; skew 500 ppm
Aug 09 02:27:24 dist-test-slave-68xk krb5kdc[6031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242444, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:27:24.341461 6970 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:27:24.342746 6970 webserver.cc:460] Webserver started at http://127.21.214.130:37493/ using document root <none> and password file <none>
I20260809 02:27:24.343576 6970 fs_manager.cc:359] Metadata directory not provided
I20260809 02:27:24.343724 6970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:27:24.343973 6970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:27:24 dist-test-slave-68xk krb5kdc[6031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242444, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:27:24.359858 6970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "30d79b70a52c4091b2e2bfb50e577e63"
format_stamp: "Formatted at 2026-08-09 02:27:24 on dist-test-slave-68xk"
server_key: "bc237300974b7ee455d00bf4196ebf56"
server_key_iv: "7c27866398e805e5b420d98c72f75a20"
server_key_version: "kuduclusterkey@0"
I20260809 02:27:24.360483 6970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "30d79b70a52c4091b2e2bfb50e577e63"
format_stamp: "Formatted at 2026-08-09 02:27:24 on dist-test-slave-68xk"
server_key: "bc237300974b7ee455d00bf4196ebf56"
server_key_iv: "7c27866398e805e5b420d98c72f75a20"
server_key_version: "kuduclusterkey@0"
I20260809 02:27:24.370708 6970 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.006s sys 0.000s
I20260809 02:27:24.389034 6990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:27:24.390700 6970 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:27:24.390870 6970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "30d79b70a52c4091b2e2bfb50e577e63"
format_stamp: "Formatted at 2026-08-09 02:27:24 on dist-test-slave-68xk"
server_key: "bc237300974b7ee455d00bf4196ebf56"
server_key_iv: "7c27866398e805e5b420d98c72f75a20"
server_key_version: "kuduclusterkey@0"
I20260809 02:27:24.391050 6970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:27:24.413612 6970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:27:24.421773 6970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:27:24.422077 6970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:27:24.422919 6970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:27:24.424082 6970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:27:24.424211 6970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:27:24.424324 6970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:27:24.424397 6970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:27:24.440670 6970 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:41709
I20260809 02:27:24.440752 7135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:41709 every 8 connection(s)
I20260809 02:27:24.442020 6970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:27:24.448586 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 6970
I20260809 02:27:24.448716 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:27:24.449064 22362 external_mini_cluster.cc:1428] Setting key 9609592abd6154ce7ffa21de3344957c
Aug 09 02:27:24 dist-test-slave-68xk krb5kdc[6031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242444, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
I20260809 02:27:24.463111 6964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:24.444560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:57853 (local address 127.21.214.190:42413)
0809 02:27:24.446164 (+ 1604us) server_negotiation.cc:206] Beginning negotiation
0809 02:27:24.446169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:27:24.446202 (+ 33us) server_negotiation.cc:407] Connection header received
0809 02:27:24.447280 (+ 1078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:27:24.447284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:27:24.447342 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:27:24.447440 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:27:24.449095 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.450017 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.455012 (+ 4995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.455384 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.455468 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:24.458734 (+ 3266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:27:24.458738 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:27:24.458741 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:27:24.458771 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:27:24.460572 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:27:24.461211 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:27:24.461215 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:27:24.461217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:27:24.461328 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:27:24.461761 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:27:24.461765 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:27:24.461767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:27:24.461986 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:27:24.462074 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:27:24.462812 (+ 738us) server_negotiation.cc:299] Negotiation successful
0809 02:27:24.462946 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1494}
I20260809 02:27:24.464689 7138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:24.445082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:42413 (local address 127.21.214.130:57853)
0809 02:27:24.445699 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0809 02:27:24.445765 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 02:27:24.446982 (+ 1217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:27:24.447671 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:27:24.447682 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:27:24.448117 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:27:24.448859 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:24.448885 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.450577 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.450581 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:24.454850 (+ 4269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:24.454862 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.455686 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.455691 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:24.455894 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:24.456639 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:27:24.456661 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:27:24.458524 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:27:24.460721 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:27:24.460727 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:27:24.460744 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:27:24.461077 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:27:24.461454 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:27:24.461457 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:27:24.461459 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:27:24.461640 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:27:24.462147 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:27:24.462152 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:27:24.462522 (+ 370us) client_negotiation.cc:769] Sending connection context
0809 02:27:24.463293 (+ 771us) client_negotiation.cc:240] Negotiation successful
0809 02:27:24.463633 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":156,"threads_started":1}
I20260809 02:27:24.465997 7136 heartbeater.cc:347] Connected to a master server at 127.21.214.190:42413
I20260809 02:27:24.466308 7136 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
I20260809 02:27:24.467171 7136 heartbeater.cc:511] Master 127.21.214.190:42413 requested a full tablet report, sending...
I20260809 02:27:24.470579 6682 ts_manager.cc:194] Registered new tserver with Master: 30d79b70a52c4091b2e2bfb50e577e63 (127.21.214.130:41709)
I20260809 02:27:24.471436 6682 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:57853
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:27:24.498625 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.214.148:37465/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42413
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:35719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:27:24.705566 7144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:27:24.705982 7144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:27:24.706061 7144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:27:24.713595 7144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:27:24.713801 7144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:27:24.713976 7144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:27:24.723553 7144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:35719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.21.214.148:37465/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:27:24.725680 7144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:27:24.727252 7144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 09 02:27:24 dist-test-slave-68xk krb5kdc[6031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242444, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:27:24.759779 7144 server_base.cc:1034] running on GCE node
W20260809 02:27:24.760923 7151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:27:24.760540 7153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:27:24.767223 7155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:27:24.768067 7144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:27:24.768927 7144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:27:24.772704 7144 hybrid_clock.cc:648] HybridClock initialized: now 1786242444772622 us; error 90 us; skew 500 ppm
Aug 09 02:27:24 dist-test-slave-68xk krb5kdc[6031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242444, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:27:24.776605 7144 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:27:24.777746 7144 webserver.cc:460] Webserver started at http://127.21.214.131:40535/ using document root <none> and password file <none>
I20260809 02:27:24.778508 7144 fs_manager.cc:359] Metadata directory not provided
I20260809 02:27:24.778652 7144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:27:24.778931 7144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:27:24 dist-test-slave-68xk krb5kdc[6031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242444, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:27:24.803288 7144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "b9830d28f82744b19ad0d9b4da441ff0"
format_stamp: "Formatted at 2026-08-09 02:27:24 on dist-test-slave-68xk"
server_key: "65f42451dd191b886fcbeed7c76b66a1"
server_key_iv: "3ce1c0bbc78b83c59147f1f35e563733"
server_key_version: "kuduclusterkey@0"
I20260809 02:27:24.804371 7144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "b9830d28f82744b19ad0d9b4da441ff0"
format_stamp: "Formatted at 2026-08-09 02:27:24 on dist-test-slave-68xk"
server_key: "65f42451dd191b886fcbeed7c76b66a1"
server_key_iv: "3ce1c0bbc78b83c59147f1f35e563733"
server_key_version: "kuduclusterkey@0"
I20260809 02:27:24.825228 7144 fs_manager.cc:691] Time spent creating directory manager: real 0.020s user 0.001s sys 0.004s
I20260809 02:27:24.857771 7163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:27:24.859584 7144 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260809 02:27:24.859724 7144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "b9830d28f82744b19ad0d9b4da441ff0"
format_stamp: "Formatted at 2026-08-09 02:27:24 on dist-test-slave-68xk"
server_key: "65f42451dd191b886fcbeed7c76b66a1"
server_key_iv: "3ce1c0bbc78b83c59147f1f35e563733"
server_key_version: "kuduclusterkey@0"
I20260809 02:27:24.859867 7144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:27:24.887528 7144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:27:24.891464 7144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:27:24.891753 7144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:27:24.892540 7144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:27:24.893687 7144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:27:24.893806 7144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:27:24.893919 7144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:27:24.893985 7144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:27:24.905364 7144 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:38899
I20260809 02:27:24.906780 7144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:27:24.916365 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 7144
I20260809 02:27:24.916500 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:27:24.916846 22362 external_mini_cluster.cc:1428] Setting key 4fde0e7bf73331a245e1c4fded414c8b
I20260809 02:27:24.922653 7322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:38899 every 8 connection(s)
Aug 09 02:27:24 dist-test-slave-68xk krb5kdc[6031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242444, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:27:24.947130 6964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:24.924951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:57285 (local address 127.21.214.190:42413)
0809 02:27:24.925120 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 02:27:24.925124 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:27:24.929685 (+ 4561us) server_negotiation.cc:407] Connection header received
0809 02:27:24.931042 (+ 1357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:27:24.931045 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:27:24.931101 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:27:24.931172 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:27:24.932967 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.933812 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.935661 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.936004 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.936088 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:24.940721 (+ 4633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:27:24.940725 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:27:24.940728 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:27:24.940756 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:27:24.944372 (+ 3616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:27:24.945113 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:27:24.945116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:27:24.945118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:27:24.945215 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:27:24.945685 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:27:24.945689 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:27:24.945691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:27:24.945940 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:27:24.946028 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 02:27:24.946819 (+ 791us) server_negotiation.cc:299] Negotiation successful
0809 02:27:24.946953 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 02:27:24.949133 7327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:24.925555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:42413 (local address 127.21.214.131:57285)
0809 02:27:24.929496 (+ 3941us) negotiation.cc:107] Waiting for socket to connect
0809 02:27:24.929562 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 02:27:24.930794 (+ 1232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:27:24.931610 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:27:24.931620 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:27:24.932055 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:27:24.932780 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:24.932800 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.933980 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.933983 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:24.935512 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:24.935523 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.936329 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.936333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:24.936531 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:24.938620 (+ 2089us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:27:24.938644 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:27:24.940497 (+ 1853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:27:24.944542 (+ 4045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:27:24.944548 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:27:24.944565 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:27:24.944962 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:27:24.945346 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:27:24.945350 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:27:24.945352 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:27:24.945554 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:27:24.946100 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:27:24.946107 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:27:24.946487 (+ 380us) client_negotiation.cc:769] Sending connection context
0809 02:27:24.947601 (+ 1114us) client_negotiation.cc:240] Negotiation successful
0809 02:27:24.948012 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3675,"thread_start_us":212,"threads_started":1}
I20260809 02:27:24.950795 7323 heartbeater.cc:347] Connected to a master server at 127.21.214.190:42413
I20260809 02:27:24.951052 7323 heartbeater.cc:464] Registering TS with master...
I20260809 02:27:24.951635 7323 heartbeater.cc:511] Master 127.21.214.190:42413 requested a full tablet report, sending...
I20260809 02:27:24.952777 6682 ts_manager.cc:194] Registered new tserver with Master: b9830d28f82744b19ad0d9b4da441ff0 (127.21.214.131:38899)
I20260809 02:27:24.953511 6682 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:57285
I20260809 02:27:24.957309 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:27:24.971135 6964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:24.960080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58568 (local address 127.21.214.190:42413)
0809 02:27:24.960264 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 02:27:24.960269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:27:24.961059 (+ 790us) server_negotiation.cc:407] Connection header received
0809 02:27:24.961269 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:27:24.961272 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:27:24.961324 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:27:24.961381 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:27:24.962588 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.963406 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.964657 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.964955 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.965056 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:24.967096 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:27:24.967100 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:27:24.967103 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:27:24.967130 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:27:24.969100 (+ 1970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:27:24.969641 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:27:24.969645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:27:24.969647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:27:24.969739 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:27:24.970066 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:27:24.970070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:27:24.970072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:27:24.970296 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:27:24.970403 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 02:27:24.970845 (+ 442us) server_negotiation.cc:299] Negotiation successful
0809 02:27:24.970972 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:27:24.975087 6682 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58568:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:27:24.979252 6682 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:27:24.997495 7343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:24.989443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38782 (local address 127.21.214.130:41709)
0809 02:27:24.989858 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0809 02:27:24.989868 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:27:24.989896 (+ 28us) server_negotiation.cc:407] Connection header received
0809 02:27:24.990182 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:27:24.990189 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:27:24.990433 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:27:24.990600 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:27:24.991095 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.992189 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.994638 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.995488 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.995587 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:24.995720 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 02:27:24.997179 (+ 1459us) server_negotiation.cc:299] Negotiation successful
0809 02:27:24.997320 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":86,"threads_started":1}
I20260809 02:27:24.998238 7342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:24.989296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:41709 (local address 127.0.0.1:38782)
0809 02:27:24.989758 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0809 02:27:24.989810 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:27:24.989956 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:27:24.990767 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:27:24.990775 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:27:24.990803 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:27:24.990956 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:24.990964 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.992419 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.992423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:24.994493 (+ 2070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:24.994505 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.995865 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.995868 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:24.996790 (+ 922us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:24.996958 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 02:27:24.997959 (+ 1001us) client_negotiation.cc:240] Negotiation successful
0809 02:27:24.998093 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":147,"threads_started":1}
I20260809 02:27:25.002648 7345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:24.990676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:43879 (local address 127.0.0.1:55400)
0809 02:27:24.993256 (+ 2580us) negotiation.cc:107] Waiting for socket to connect
0809 02:27:24.993268 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:27:24.993350 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:27:24.995524 (+ 2174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:27:24.995528 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:27:24.995547 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:27:24.995668 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:24.995674 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.999037 (+ 3363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.999041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:25.000912 (+ 1871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:25.000923 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:25.002120 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.002124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:25.002225 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:25.002249 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:27:25.002320 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 02:27:25.002387 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":93,"threads_started":1}
I20260809 02:27:25.002206 7050 tablet_service.cc:1467] Processing CreateTablet for tablet ec545a82ad5241269fe0b04da66fc440 (DEFAULT_TABLE table=test-table [id=90b3383ebe02463181474c37a95781a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:27:25.003347 7346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:24.990858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55400 (local address 127.21.214.129:43879)
0809 02:27:24.991224 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0809 02:27:24.991232 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:27:24.994896 (+ 3664us) server_negotiation.cc:407] Connection header received
0809 02:27:24.994987 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:27:24.994993 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:27:24.995201 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:27:24.995368 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:27:24.995908 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.998903 (+ 2995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.001051 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:25.001816 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.001934 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:25.002058 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 02:27:25.003092 (+ 1034us) server_negotiation.cc:299] Negotiation successful
0809 02:27:25.003213 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":111,"threads_started":1}
I20260809 02:27:25.004420 7344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:24.990222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:38899 (local address 127.0.0.1:34028)
0809 02:27:24.990875 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0809 02:27:24.990889 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:27:24.990970 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:27:24.992977 (+ 2007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:27:24.992981 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:27:24.993002 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:27:24.993105 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:24.993111 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.997001 (+ 3890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.997005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:24.998328 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:24.998343 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:25.004011 (+ 5668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.004014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:25.004114 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:25.004135 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:27:25.004218 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 02:27:25.004285 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":194,"threads_started":1}
I20260809 02:27:25.005857 7347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:24.991140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34028 (local address 127.21.214.131:38899)
0809 02:27:24.992116 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0809 02:27:24.992132 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:27:24.992161 (+ 29us) server_negotiation.cc:407] Connection header received
0809 02:27:24.992245 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:27:24.992251 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:27:24.992454 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:27:24.992643 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:27:24.993475 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.994752 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:24.998578 (+ 3826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:24.999451 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.003805 (+ 4354us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:25.003943 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 02:27:25.005549 (+ 1606us) server_negotiation.cc:299] Negotiation successful
0809 02:27:25.005665 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":162,"threads_started":1}
I20260809 02:27:25.006991 6875 tablet_service.cc:1467] Processing CreateTablet for tablet ec545a82ad5241269fe0b04da66fc440 (DEFAULT_TABLE table=test-table [id=90b3383ebe02463181474c37a95781a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:27:25.008390 6875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec545a82ad5241269fe0b04da66fc440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:27:25.010519 7050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec545a82ad5241269fe0b04da66fc440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:27:25.016907 7221 tablet_service.cc:1467] Processing CreateTablet for tablet ec545a82ad5241269fe0b04da66fc440 (DEFAULT_TABLE table=test-table [id=90b3383ebe02463181474c37a95781a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:27:25.018118 7221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec545a82ad5241269fe0b04da66fc440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:27:25.029369 7353 tablet_bootstrap.cc:492] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63: Bootstrap starting.
I20260809 02:27:25.030709 7352 tablet_bootstrap.cc:492] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6: Bootstrap starting.
I20260809 02:27:25.032369 7353 tablet_bootstrap.cc:654] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63: Neither blocks nor log segments found. Creating new log.
I20260809 02:27:25.033180 7352 tablet_bootstrap.cc:654] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6: Neither blocks nor log segments found. Creating new log.
I20260809 02:27:25.033502 7353 log.cc:824] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63: Log is configured to *not* fsync() on all Append() calls
I20260809 02:27:25.034150 7352 log.cc:824] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6: Log is configured to *not* fsync() on all Append() calls
I20260809 02:27:25.034353 7354 tablet_bootstrap.cc:492] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0: Bootstrap starting.
I20260809 02:27:25.037101 7354 tablet_bootstrap.cc:654] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0: Neither blocks nor log segments found. Creating new log.
I20260809 02:27:25.038924 7353 tablet_bootstrap.cc:492] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63: No bootstrap required, opened a new log
I20260809 02:27:25.039008 7352 tablet_bootstrap.cc:492] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6: No bootstrap required, opened a new log
I20260809 02:27:25.039230 7352 ts_tablet_manager.cc:1397] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260809 02:27:25.039216 7353 ts_tablet_manager.cc:1397] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260809 02:27:25.044102 7354 log.cc:824] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0: Log is configured to *not* fsync() on all Append() calls
I20260809 02:27:25.044312 7352 raft_consensus.cc:348] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d79b70a52c4091b2e2bfb50e577e63" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41709 } } peers { permanent_uuid: "b9830d28f82744b19ad0d9b4da441ff0" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 38899 } } peers { permanent_uuid: "dbd8c15921bd447ca20d9bc7047bb4d6" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 43879 } }
I20260809 02:27:25.044747 7352 raft_consensus.cc:374] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:27:25.044862 7352 raft_consensus.cc:729] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd8c15921bd447ca20d9bc7047bb4d6, State: Initialized, Role: FOLLOWER
I20260809 02:27:25.045521 7352 consensus_queue.cc:260] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d79b70a52c4091b2e2bfb50e577e63" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41709 } } peers { permanent_uuid: "b9830d28f82744b19ad0d9b4da441ff0" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 38899 } } peers { permanent_uuid: "dbd8c15921bd447ca20d9bc7047bb4d6" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 43879 } }
I20260809 02:27:25.045909 7353 raft_consensus.cc:348] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d79b70a52c4091b2e2bfb50e577e63" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41709 } } peers { permanent_uuid: "b9830d28f82744b19ad0d9b4da441ff0" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 38899 } } peers { permanent_uuid: "dbd8c15921bd447ca20d9bc7047bb4d6" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 43879 } }
I20260809 02:27:25.046761 7353 raft_consensus.cc:374] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:27:25.046871 7353 raft_consensus.cc:729] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d79b70a52c4091b2e2bfb50e577e63, State: Initialized, Role: FOLLOWER
I20260809 02:27:25.047011 7352 ts_tablet_manager.cc:1428] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6: Time spent starting tablet: real 0.008s user 0.004s sys 0.003s
I20260809 02:27:25.047479 6962 heartbeater.cc:503] Master 127.21.214.190:42413 was elected leader, sending a full tablet report...
I20260809 02:27:25.047432 7353 consensus_queue.cc:260] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d79b70a52c4091b2e2bfb50e577e63" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41709 } } peers { permanent_uuid: "b9830d28f82744b19ad0d9b4da441ff0" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 38899 } } peers { permanent_uuid: "dbd8c15921bd447ca20d9bc7047bb4d6" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 43879 } }
I20260809 02:27:25.048477 7353 ts_tablet_manager.cc:1428] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260809 02:27:25.049181 7136 heartbeater.cc:503] Master 127.21.214.190:42413 was elected leader, sending a full tablet report...
I20260809 02:27:25.050947 7354 tablet_bootstrap.cc:492] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0: No bootstrap required, opened a new log
I20260809 02:27:25.051177 7354 ts_tablet_manager.cc:1397] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20260809 02:27:25.055648 7354 raft_consensus.cc:348] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d79b70a52c4091b2e2bfb50e577e63" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41709 } } peers { permanent_uuid: "b9830d28f82744b19ad0d9b4da441ff0" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 38899 } } peers { permanent_uuid: "dbd8c15921bd447ca20d9bc7047bb4d6" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 43879 } }
I20260809 02:27:25.056023 7354 raft_consensus.cc:374] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:27:25.056141 7354 raft_consensus.cc:729] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9830d28f82744b19ad0d9b4da441ff0, State: Initialized, Role: FOLLOWER
I20260809 02:27:25.056774 7354 consensus_queue.cc:260] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d79b70a52c4091b2e2bfb50e577e63" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41709 } } peers { permanent_uuid: "b9830d28f82744b19ad0d9b4da441ff0" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 38899 } } peers { permanent_uuid: "dbd8c15921bd447ca20d9bc7047bb4d6" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 43879 } }
I20260809 02:27:25.057966 7354 ts_tablet_manager.cc:1428] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 02:27:25.058394 7323 heartbeater.cc:503] Master 127.21.214.190:42413 was elected leader, sending a full tablet report...
W20260809 02:27:25.084421 6963 tablet.cc:2369] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 02:27:25 dist-test-slave-68xk krb5kdc[6031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242444, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
W20260809 02:27:25.173553 7324 tablet.cc:2369] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:27:25.193710 7137 tablet.cc:2369] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:27:25.304584 7360 raft_consensus.cc:482] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:27:25.304847 7360 raft_consensus.cc:504] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d79b70a52c4091b2e2bfb50e577e63" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41709 } } peers { permanent_uuid: "b9830d28f82744b19ad0d9b4da441ff0" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 38899 } } peers { permanent_uuid: "dbd8c15921bd447ca20d9bc7047bb4d6" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 43879 } }
I20260809 02:27:25.306211 7360 leader_election.cc:288] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30d79b70a52c4091b2e2bfb50e577e63 (127.21.214.130:41709), dbd8c15921bd447ca20d9bc7047bb4d6 (127.21.214.129:43879)
I20260809 02:27:25.312268 7327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:25.306811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:41709 (local address 127.21.214.131:47205)
0809 02:27:25.307419 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0809 02:27:25.307434 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:27:25.307529 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:27:25.308134 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:27:25.308137 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:27:25.308147 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:27:25.308268 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:25.308273 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:25.309298 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.309302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:25.310557 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:25.310578 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:25.311863 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.311867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:25.311965 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:25.311988 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:27:25.312064 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:27:25.312133 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532}
I20260809 02:27:25.312307 7343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:25.307737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:47205 (local address 127.21.214.130:41709)
0809 02:27:25.307883 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 02:27:25.307888 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:27:25.307906 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:27:25.307965 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:27:25.307969 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:27:25.308017 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:27:25.308132 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:27:25.308366 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:25.309156 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.310699 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:25.311324 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.311450 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:25.311505 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:27:25.312091 (+ 586us) server_negotiation.cc:299] Negotiation successful
0809 02:27:25.312174 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:27:25.313339 7074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec545a82ad5241269fe0b04da66fc440" candidate_uuid: "b9830d28f82744b19ad0d9b4da441ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d79b70a52c4091b2e2bfb50e577e63" is_pre_election: true
I20260809 02:27:25.313673 7074 raft_consensus.cc:2454] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9830d28f82744b19ad0d9b4da441ff0 in term 0.
I20260809 02:27:25.314242 7165 leader_election.cc:302] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d79b70a52c4091b2e2bfb50e577e63, b9830d28f82744b19ad0d9b4da441ff0; no voters:
I20260809 02:27:25.314584 7360 raft_consensus.cc:2781] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:27:25.314662 7360 raft_consensus.cc:482] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:27:25.314702 7360 raft_consensus.cc:3037] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:27:25.316093 7360 raft_consensus.cc:504] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d79b70a52c4091b2e2bfb50e577e63" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41709 } } peers { permanent_uuid: "b9830d28f82744b19ad0d9b4da441ff0" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 38899 } } peers { permanent_uuid: "dbd8c15921bd447ca20d9bc7047bb4d6" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 43879 } }
I20260809 02:27:25.316478 7360 leader_election.cc:288] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [CANDIDATE]: Term 1 election: Requested vote from peers 30d79b70a52c4091b2e2bfb50e577e63 (127.21.214.130:41709), dbd8c15921bd447ca20d9bc7047bb4d6 (127.21.214.129:43879)
I20260809 02:27:25.317283 7074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec545a82ad5241269fe0b04da66fc440" candidate_uuid: "b9830d28f82744b19ad0d9b4da441ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d79b70a52c4091b2e2bfb50e577e63"
I20260809 02:27:25.317446 7074 raft_consensus.cc:3037] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:27:25.319115 7074 raft_consensus.cc:2454] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9830d28f82744b19ad0d9b4da441ff0 in term 1.
I20260809 02:27:25.319447 7165 leader_election.cc:302] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d79b70a52c4091b2e2bfb50e577e63, b9830d28f82744b19ad0d9b4da441ff0; no voters:
I20260809 02:27:25.319651 7360 raft_consensus.cc:2781] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:27:25.319955 7360 raft_consensus.cc:686] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [term 1 LEADER]: Becoming Leader. State: Replica: b9830d28f82744b19ad0d9b4da441ff0, State: Running, Role: LEADER
I20260809 02:27:25.320355 7360 consensus_queue.cc:237] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d79b70a52c4091b2e2bfb50e577e63" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41709 } } peers { permanent_uuid: "b9830d28f82744b19ad0d9b4da441ff0" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 38899 } } peers { permanent_uuid: "dbd8c15921bd447ca20d9bc7047bb4d6" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 43879 } }
I20260809 02:27:25.322499 7346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:25.307263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:40635 (local address 127.21.214.129:43879)
0809 02:27:25.307444 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 02:27:25.307449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:27:25.308246 (+ 797us) server_negotiation.cc:407] Connection header received
0809 02:27:25.309337 (+ 1091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:27:25.309341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:27:25.309393 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:27:25.309467 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:27:25.311033 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:25.311735 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.321072 (+ 9337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:25.321686 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.321794 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:25.321850 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 02:27:25.322233 (+ 383us) server_negotiation.cc:299] Negotiation successful
0809 02:27:25.322323 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 02:27:25.322902 7365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:25.307078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:43879 (local address 127.21.214.131:40635)
0809 02:27:25.307973 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0809 02:27:25.307986 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:27:25.308110 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:27:25.310719 (+ 2609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:27:25.310721 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:27:25.310741 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:27:25.310893 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:25.310898 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:25.317114 (+ 6216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.317118 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:25.320894 (+ 3776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:27:25.320907 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:27:25.321983 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.321986 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:27:25.322083 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:25.322107 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:27:25.322663 (+ 556us) client_negotiation.cc:240] Negotiation successful
0809 02:27:25.322745 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":832,"thread_start_us":142,"threads_started":1}
I20260809 02:27:25.324868 6680 catalog_manager.cc:5495] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b9830d28f82744b19ad0d9b4da441ff0 (127.21.214.131). New cstate: current_term: 1 leader_uuid: "b9830d28f82744b19ad0d9b4da441ff0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30d79b70a52c4091b2e2bfb50e577e63" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9830d28f82744b19ad0d9b4da441ff0" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 38899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd8c15921bd447ca20d9bc7047bb4d6" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 43879 } health_report { overall_health: UNKNOWN } } }
I20260809 02:27:25.325592 6902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec545a82ad5241269fe0b04da66fc440" candidate_uuid: "b9830d28f82744b19ad0d9b4da441ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd8c15921bd447ca20d9bc7047bb4d6"
I20260809 02:27:25.325830 6902 raft_consensus.cc:3037] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:27:25.327194 6902 raft_consensus.cc:2454] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9830d28f82744b19ad0d9b4da441ff0 in term 1.
I20260809 02:27:25.327528 6883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec545a82ad5241269fe0b04da66fc440" candidate_uuid: "b9830d28f82744b19ad0d9b4da441ff0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd8c15921bd447ca20d9bc7047bb4d6" is_pre_election: true
I20260809 02:27:25.327657 6883 raft_consensus.cc:2362] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b9830d28f82744b19ad0d9b4da441ff0 in term 1. Re-sending same reply.
I20260809 02:27:25.365191 7347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:25.360641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34032 (local address 127.21.214.131:38899)
0809 02:27:25.360775 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 02:27:25.360780 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:27:25.360830 (+ 50us) server_negotiation.cc:407] Connection header received
0809 02:27:25.361036 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:27:25.361039 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:27:25.361107 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:27:25.361216 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:27:25.361488 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:25.362279 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.363493 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:27:25.363794 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:27:25.363898 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:27:25.364215 (+ 317us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:27:25.364745 (+ 530us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:27:25.364866 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:27:25.364956 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 02:27:25.365014 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 02:27:25.374925 6883 raft_consensus.cc:1261] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6 [term 1 FOLLOWER]: Refusing update from remote peer b9830d28f82744b19ad0d9b4da441ff0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:27:25.375181 7074 raft_consensus.cc:1261] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63 [term 1 FOLLOWER]: Refusing update from remote peer b9830d28f82744b19ad0d9b4da441ff0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:27:25.376008 7360 consensus_queue.cc:1035] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd8c15921bd447ca20d9bc7047bb4d6" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 43879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:27:25.376205 7366 consensus_queue.cc:1035] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d79b70a52c4091b2e2bfb50e577e63" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:27:25.386270 7375 mvcc.cc:205] Tried to move back new op lower bound from 7316449056246153216 to 7316449056036397056. Current Snapshot: MvccSnapshot[applied={T|T < 7316449056246153216}]
I20260809 02:27:25.387086 7372 mvcc.cc:205] Tried to move back new op lower bound from 7316449056246153216 to 7316449056036397056. Current Snapshot: MvccSnapshot[applied={T|T < 7316449056246153216 or (T in {7316449056246153216})}]
I20260809 02:27:25.389741 7377 mvcc.cc:205] Tried to move back new op lower bound from 7316449056246153216 to 7316449056036397056. Current Snapshot: MvccSnapshot[applied={T|T < 7316449056246153216}]
I20260809 02:27:25.393231 6680 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:27:25.393838 6680 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:27:25.396574 6680 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 83bc97bb06b6465f9cb4990a527801d9: Sending DeleteTablet for 3 replicas of tablet ec545a82ad5241269fe0b04da66fc440
I20260809 02:27:25.397603 7221 tablet_service.cc:1514] Processing DeleteTablet for tablet ec545a82ad5241269fe0b04da66fc440 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:27:25 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:34028
I20260809 02:27:25.398058 7050 tablet_service.cc:1514] Processing DeleteTablet for tablet ec545a82ad5241269fe0b04da66fc440 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:27:25 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:38782
I20260809 02:27:25.398537 7391 tablet_replica.cc:330] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63: stopping tablet replica
I20260809 02:27:25.398500 6875 tablet_service.cc:1514] Processing DeleteTablet for tablet ec545a82ad5241269fe0b04da66fc440 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:27:25 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:55400
I20260809 02:27:25.398862 7391 raft_consensus.cc:2229] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:27:25.399354 7392 tablet_replica.cc:330] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6: stopping tablet replica
I20260809 02:27:25.399451 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 6791
I20260809 02:27:25.399670 7392 raft_consensus.cc:2229] T ec545a82ad5241269fe0b04da66fc440 P dbd8c15921bd447ca20d9bc7047bb4d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:27:25.400498 7390 tablet_replica.cc:330] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0: stopping tablet replica
I20260809 02:27:25.400810 7390 raft_consensus.cc:2229] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:27:25.401283 7390 raft_consensus.cc:2258] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:27:25.405349 7390 ts_tablet_manager.cc:1905] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:27:25.409762 7390 ts_tablet_manager.cc:1918] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:27:25.409898 7390 log.cc:1196] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/ec545a82ad5241269fe0b04da66fc440
I20260809 02:27:25.410358 7390 ts_tablet_manager.cc:1939] T ec545a82ad5241269fe0b04da66fc440 P b9830d28f82744b19ad0d9b4da441ff0: Deleting consensus metadata
I20260809 02:27:25.427181 6663 catalog_manager.cc:4841] TS b9830d28f82744b19ad0d9b4da441ff0 (127.21.214.131:38899): tablet ec545a82ad5241269fe0b04da66fc440 (table test-table [id=90b3383ebe02463181474c37a95781a2]) successfully deleted
I20260809 02:27:25.427662 7391 raft_consensus.cc:2258] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:27:25.429751 7391 ts_tablet_manager.cc:1905] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:27:25.433533 7391 ts_tablet_manager.cc:1918] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:27:25.433674 7391 log.cc:1196] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/ec545a82ad5241269fe0b04da66fc440
I20260809 02:27:25.434027 7391 ts_tablet_manager.cc:1939] T ec545a82ad5241269fe0b04da66fc440 P 30d79b70a52c4091b2e2bfb50e577e63: Deleting consensus metadata
W20260809 02:27:25.435094 6663 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:43879 (error 108)
I20260809 02:27:25.436091 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 6970
I20260809 02:27:25.445597 7344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:25.444568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:43879 (local address 127.0.0.1:55412)
0809 02:27:25.445403 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0809 02:27:25.445488 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:43879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":733}
W20260809 02:27:25.445928 6663 catalog_manager.cc:4584] TS dbd8c15921bd447ca20d9bc7047bb4d6 (127.21.214.129:43879): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ec545a82ad5241269fe0b04da66fc440: Network error: Client connection negotiation failed: client connection to 127.21.214.129:43879: connect: Connection refused (error 111)
I20260809 02:27:25.455991 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 7144
I20260809 02:27:25.458966 7344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:27:25.458602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:41709 (local address 127.0.0.1:38792)
0809 02:27:25.458811 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 02:27:25.458869 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.130:41709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260809 02:27:25.466058 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 6638
I20260809 02:27:25.489697 22362 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 02:27:25.846724 22362 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 02:27:25.846894 22362 mini_ranger.cc:66] Stopping Ranger...
I20260809 02:27:26.201623 22362 mini_ranger.cc:68] Stopped Ranger
2026-08-09 02:27:26.201 UTC [6072] LOG: received smart shutdown request
2026-08-09 02:27:26.206 UTC [6072] LOG: background worker "logical replication launcher" (PID 6084) exited with exit code 1
2026-08-09 02:27:26.206 UTC [6076] LOG: shutting down
2026-08-09 02:27:26.373 UTC [6072] LOG: database system is shut down
2026-08-09T02:27:26Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50795 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:27:26 dist-test-slave-68xk krb5kdc[7408](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:27:26 dist-test-slave-68xk krb5kdc[7408](info): set up 2 sockets
Aug 09 02:27:26 dist-test-slave-68xk krb5kdc[7408](info): commencing operation
krb5kdc: starting...
W20260809 02:27:27.748497 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:27:27 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:27:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:27:27Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.21.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.21.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/rangeradmin_127.21.214.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/rangeradmin_127.21.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.21.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.21.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/rangerlookup_127.21.214.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/rangerlookup_127.21.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.21.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.21.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/HTTP_127.21.214.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/HTTP_127.21.214.148@KRBTEST.COM.keytab.
I20260809 02:27:27.937031 22362 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskplQfV_/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/postgres -l logfile start
2026-08-09 02:27:30.526 UTC [7447] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 02:27:30.526 UTC [7447] LOG: listening on IPv4 address "127.21.214.148", port 34383
2026-08-09 02:27:30.530 UTC [7447] LOG: listening on Unix socket "/tmp/.s.PGSQL.34383"
2026-08-09 02:27:30.552 UTC [7453] LOG: database system was shut down at 2026-08-09 02:27:29 UTC
2026-08-09 02:27:30.556 UTC [7447] LOG: database system is ready to accept connections
I20260809 02:27:31.789273 22362 mini_postgres.cc:96] Postgres bound to 34383
2026-08-09 02:27:31.797 UTC [7464] FATAL: database "slave" does not exist
127.21.214.148:34383 - accepting connections
I20260809 02:27:31.798599 22362 mini_ranger.cc:161] Starting Ranger...
I20260809 02:27:31.815001 22362 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 02:27:32.354490 22362 mini_ranger.cc:87] Created ranger Postgres database
I20260809 02:27:32.354588 22362 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-admin
2026-08-09 02:27:32,657 [I] DB FLAVOR :POSTGRES
2026-08-09 02:27:32,658 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 02:27:32,658 [I] Checking connection..
2026-08-09 02:27:32,658 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 02:27:32,934 [I] Checking connection passed.
2026-08-09 02:27:32,935 [I] --------- Verifying version history table ---------
2026-08-09 02:27:32,935 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:27:33,200 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 02:27:33,201 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:27:33,476 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 02:27:33,477 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 02:27:33,477 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 02:27:33.730 UTC [7540] WARNING: there is no transaction in progress
2026-08-09 02:27:33,739 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 02:27:33,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 02:27:33,994 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 02:27:33,994 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 02:27:33,995 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 02:27:34,240 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 02:27:34,510 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-68xk.c.gcp-upstream.internal','N') ;"
2026-08-09 02:27:34,762 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 02:27:35,052 [I] Table x_portal_user does not exist in database ranger
2026-08-09 02:27:35,053 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 02:27:35,311 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 02:27:35,311 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 02:27:35,554 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 02:27:35,798 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 02:27:35,798 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 02:27:36.779 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:36.797 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:36.816 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:36.834 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:36.853 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:36.872 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:36.938 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:36.946 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:36.962 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:36.974 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:36.985 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:37.000 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:37.012 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:37.019 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:37.026 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:37.032 UTC [7688] WARNING: there is no transaction in progress
2026-08-09 02:27:37,738 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 02:27:37,739 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 02:27:37,990 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 02:27:37,990 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 02:27:38,235 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 02:27:38,235 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 02:27:38,503 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 02:27:38,504 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 02:27:38,756 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 02:27:39,008 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-68xk.c.gcp-upstream.internal';"
2026-08-09 02:27:39,264 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 02:27:39,264 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 02:27:39,521 [I] DB_PATCHES have already been applied
I20260809 02:27:39.527266 22362 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-admin:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskplQfV_/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 02:27:39.527333 22362 mini_ranger.cc:193] Using host: 127.21.214.148
I20260809 02:27:39.531876 22362 mini_ranger.cc:227] Ranger admin URL: http://127.21.214.148:34493
Aug 09, 2026 2:27:39 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 2:27:39 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 2:27:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 2:27:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 2:27:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 2:27:40 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 2:27:40 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 02:27:40.873314 22362 mini_ranger.cc:160] Time spent starting Ranger: real 9.075s user 0.004s sys 0.010s
Aug 09, 2026 2:28:02 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 2:28:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 09, 2026 2:28:02 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 2:28:02 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 2:28:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 2:28:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 2:28:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 2:28:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 2:28:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 2:28:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 2:28:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 2:28:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 2:28:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 2:28:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 2:28:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 2:28:02 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 2:28:02 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 2:28:03 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 02:28:03.983244 22362 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.21.214.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.21.214.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/rangerkms_127.21.214.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.21.214.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/rangerkms_127.21.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.21.214.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.21.214.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.21.214.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/HTTP_127.21.214.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.21.214.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/HTTP_127.21.214.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 02:28:04 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242484, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 02:28:04.072985 22362 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 02:28:04.083267 22362 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 02:28:05.004915 22362 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 02:28:05.005015 22362 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-kms
I20260809 02:28:05.005057 22362 mini_ranger_kms.cc:227] Using postgres at 127.21.214.148:34383
2026-08-09 02:28:05,229 [I] DB FLAVOR :POSTGRES
2026-08-09 02:28:05,230 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 02:28:05,230 [I] Checking connection
2026-08-09 02:28:05,230 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 02:28:05,482 [I] connection success
2026-08-09 02:28:05,482 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 02:28:05,482 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 02:28:05,483 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 02:28:05,722 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 02:28:05,723 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 02:28:05,723 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 02:28:05,723 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.21.214.148:34383/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 02:28:06,024 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 02:28:06.561412 22362 mini_ranger_kms.cc:310] Created kms service
I20260809 02:28:06.795329 22362 mini_ranger_kms.cc:326] Created kudu user
I20260809 02:28:06.844909 22362 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 02:28:06 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242484, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:28:07.292804 22362 mini_ranger_kms.cc:384] Added ranger policy
I20260809 02:28:07.292985 22362 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-kms:/tmp/dist-test-taskplQfV_/build/debug/bin/postgresql.jar:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskplQfV_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 02:28:07.293020 22362 mini_ranger_kms.cc:240] Using host: 127.21.214.148
I20260809 02:28:07.298641 22362 mini_ranger_kms.cc:276] Ranger KMS PID: 7937
I20260809 02:28:07.298740 22362 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.21.214.148:58209
Aug 09, 2026 2:28:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 2:28:08 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 2:28:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 2:28:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 2:28:08 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 2:28:08 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 02:28:09 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242489, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.214.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 02:28:10 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242489, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.214.148@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:28:10.069494 22362 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.997s user 0.008s sys 0.200s
I20260809 02:28:10.069619 22362 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 02:28:10.069689 22362 mini_ranger_kms.cc:401] 127.21.214.148:58209/kms/v1/keys
Aug 09 02:28:10 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242489, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.21.214.148@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
Aug 09 02:28:12 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:28:12.961988 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:33005
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:33005
--ranger_config_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.214.148:58209/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:13.082373 7998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:13.082717 7998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:13.082762 7998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:13.086861 7998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:28:13.086930 7998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:13.086951 7998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:13.086968 7998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:28:13.086984 7998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:28:13.092653 7998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/wal
--ranger_kms_url=127.21.214.148:58209/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:33005
--ranger_config_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:33005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:13.093811 7998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:13.094941 7998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:13.103992 8004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:13.103981 8005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:13.103978 8008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:13.104354 7998 server_base.cc:1034] running on GCE node
I20260809 02:28:13.105002 7998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:13.106127 7998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:13.107348 7998 hybrid_clock.cc:648] HybridClock initialized: now 1786242493107327 us; error 38 us; skew 500 ppm
Aug 09 02:28:13 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242493, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:13.115842 7998 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:28:13.116971 7998 webserver.cc:460] Webserver started at http://127.21.214.190:36147/ using document root <none> and password file <none>
I20260809 02:28:13.117568 7998 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:13.117656 7998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:13.117928 7998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:28:13 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242493, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:28:13.166323 7998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "fe180f4defe54a02b0b897c6c6e24518"
format_stamp: "Formatted at 2026-08-09 02:28:13 on dist-test-slave-68xk"
server_key: "b14b1b6784c8f66b1554d1b62011c2c5"
server_key_iv: "30ba467e6034b9d0b2644131c22fd9b4"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:13.167069 7998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "fe180f4defe54a02b0b897c6c6e24518"
format_stamp: "Formatted at 2026-08-09 02:28:13 on dist-test-slave-68xk"
server_key: "b14b1b6784c8f66b1554d1b62011c2c5"
server_key_iv: "30ba467e6034b9d0b2644131c22fd9b4"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:13.171314 7998 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:28:13.186009 8016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:13.187513 7998 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:28:13.187655 7998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "fe180f4defe54a02b0b897c6c6e24518"
format_stamp: "Formatted at 2026-08-09 02:28:13 on dist-test-slave-68xk"
server_key: "b14b1b6784c8f66b1554d1b62011c2c5"
server_key_iv: "30ba467e6034b9d0b2644131c22fd9b4"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:13.187809 7998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:13.215134 7998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:13.218312 7998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:13.218611 7998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:13.228160 7998 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:33005
I20260809 02:28:13.228169 8078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:33005 every 8 connection(s)
I20260809 02:28:13.229218 7998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:28:13.231001 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 7998
I20260809 02:28:13.231189 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:28:13.231534 22362 external_mini_cluster.cc:1428] Setting key 9b61314daee2dc413f7efb9c0a3be8ef
I20260809 02:28:13.233035 8079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:13.240370 8079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518: Bootstrap starting.
Aug 09 02:28:13 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242492, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:13.243129 8079 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:13.244575 8079 log.cc:824] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:13.247067 8079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518: No bootstrap required, opened a new log
I20260809 02:28:13.247905 8082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:13.233048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54796 (local address 127.21.214.190:33005)
0809 02:28:13.233544 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:13.233582 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:13.233861 (+ 279us) server_negotiation.cc:407] Connection header received
0809 02:28:13.234769 (+ 908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:13.234788 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:13.235133 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:13.235493 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:13.236412 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:13.237483 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:13.238472 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:13.238982 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:13.239181 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:13.242090 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:13.242096 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:13.242111 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:13.242139 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:13.243985 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:13.244505 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:13.244511 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:13.244515 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:13.244632 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:13.244989 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:13.244993 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:13.244995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:13.245491 (+ 496us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:13.245721 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:13.246602 (+ 881us) server_negotiation.cc:299] Negotiation successful
0809 02:28:13.246898 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":143,"threads_started":1}
I20260809 02:28:13.250937 8079 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe180f4defe54a02b0b897c6c6e24518" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33005 } }
I20260809 02:28:13.251175 8079 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:13.251216 8079 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe180f4defe54a02b0b897c6c6e24518, State: Initialized, Role: FOLLOWER
I20260809 02:28:13.251722 8079 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe180f4defe54a02b0b897c6c6e24518" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33005 } }
I20260809 02:28:13.251856 8079 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:28:13.251951 8079 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:28:13.252102 8079 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:13.253087 8079 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe180f4defe54a02b0b897c6c6e24518" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33005 } }
I20260809 02:28:13.253463 8079 leader_election.cc:302] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe180f4defe54a02b0b897c6c6e24518; no voters:
I20260809 02:28:13.253803 8079 leader_election.cc:288] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:28:13.253930 8084 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:28:13.254143 8084 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 1 LEADER]: Becoming Leader. State: Replica: fe180f4defe54a02b0b897c6c6e24518, State: Running, Role: LEADER
I20260809 02:28:13.254567 8084 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe180f4defe54a02b0b897c6c6e24518" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33005 } }
I20260809 02:28:13.255234 8079 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:28:13.257416 8086 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe180f4defe54a02b0b897c6c6e24518. Latest consensus state: current_term: 1 leader_uuid: "fe180f4defe54a02b0b897c6c6e24518" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe180f4defe54a02b0b897c6c6e24518" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33005 } } }
I20260809 02:28:13.257547 8086 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:13.257862 8085 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe180f4defe54a02b0b897c6c6e24518" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe180f4defe54a02b0b897c6c6e24518" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33005 } } }
I20260809 02:28:13.257916 8079 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 02:28:13.257962 8085 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:13.257964 8101 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:28:13.265115 8101 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:28:13.272020 8101 catalog_manager.cc:1347] Generated new cluster ID: 606e98bc24c744d6ad14d9f8faeee15e
I20260809 02:28:13.272218 8101 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:28:13.302712 8101 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:28:13.303982 8101 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:28:13.309231 8101 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518: Generated new TSK 0
I20260809 02:28:13.309988 8101 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:28:14.029388 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.214.148:58209/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33005
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:14.171432 8138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:14.171785 8138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:14.171850 8138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:14.177858 8138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:14.177945 8138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:14.178033 8138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:28:14.185336 8138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.21.214.148:58209/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:14.186537 8138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:14.187635 8138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:14.198104 8149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:14.198352 8138 server_base.cc:1034] running on GCE node
W20260809 02:28:14.198069 8151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:14.198997 8147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:14.199550 8138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:14.200331 8138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:14.201489 8138 hybrid_clock.cc:648] HybridClock initialized: now 1786242494201423 us; error 83 us; skew 500 ppm
Aug 09 02:28:14 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242494, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:14.205302 8138 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:28:14.206393 8138 webserver.cc:460] Webserver started at http://127.21.214.129:40657/ using document root <none> and password file <none>
I20260809 02:28:14.207121 8138 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:14.207199 8138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:14.207441 8138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:28:14 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242494, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:28:14.225668 8138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "8a259ef236054ed2bc400b24d3a19d23"
format_stamp: "Formatted at 2026-08-09 02:28:14 on dist-test-slave-68xk"
server_key: "a0a692aa918424f5d63e63c8d427c695"
server_key_iv: "cac55f28eb67d5625e8fc505368fcb28"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:14.226780 8138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "8a259ef236054ed2bc400b24d3a19d23"
format_stamp: "Formatted at 2026-08-09 02:28:14 on dist-test-slave-68xk"
server_key: "a0a692aa918424f5d63e63c8d427c695"
server_key_iv: "cac55f28eb67d5625e8fc505368fcb28"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:14.240077 8138 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.004s sys 0.000s
I20260809 02:28:14.265986 8162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:14.269683 8138 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s
I20260809 02:28:14.269915 8138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "8a259ef236054ed2bc400b24d3a19d23"
format_stamp: "Formatted at 2026-08-09 02:28:14 on dist-test-slave-68xk"
server_key: "a0a692aa918424f5d63e63c8d427c695"
server_key_iv: "cac55f28eb67d5625e8fc505368fcb28"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:14.270151 8138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:14.289078 8138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:14.292448 8138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:14.292675 8138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:14.293365 8138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:14.294366 8138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:14.294482 8138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:14.294574 8138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:14.294631 8138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:14.305922 8138 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:42385
I20260809 02:28:14.306345 8300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:42385 every 8 connection(s)
I20260809 02:28:14.307039 8138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:28:14.309578 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 8138
I20260809 02:28:14.309711 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:28:14.310107 22362 external_mini_cluster.cc:1428] Setting key 8a8cb880bbae0edffc1449e2fe0decbf
Aug 09 02:28:14 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242494, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:28:14.327121 8304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:14.309137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:34457 (local address 127.21.214.190:33005)
0809 02:28:14.312936 (+ 3799us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:14.312949 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:14.312966 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:28:14.313013 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:14.313018 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:14.313076 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:14.313167 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:14.314884 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:14.315785 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:14.317552 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:14.317898 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:14.318014 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:14.321270 (+ 3256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:14.321274 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:14.321277 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:14.321304 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:14.323380 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:14.324046 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:14.324050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:14.324052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:14.324161 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:14.324605 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:14.324609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:14.324611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:14.324851 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:14.324951 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:14.326808 (+ 1857us) server_negotiation.cc:299] Negotiation successful
0809 02:28:14.326943 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3697,"thread_start_us":125,"threads_started":1}
I20260809 02:28:14.327128 8305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:14.309633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:33005 (local address 127.21.214.129:34457)
0809 02:28:14.311099 (+ 1466us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:14.311161 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:14.312477 (+ 1316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:14.313497 (+ 1020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:14.313509 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:14.313907 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:14.314689 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:14.314713 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:14.315976 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:14.315979 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:14.317398 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:14.317410 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:14.318221 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:14.318227 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:14.318497 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:14.319264 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:14.319287 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:14.321054 (+ 1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:14.323523 (+ 2469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:14.323528 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:14.323544 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:14.323901 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:14.324277 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:14.324281 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:14.324282 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:14.324476 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:14.325009 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:14.325015 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:14.325378 (+ 363us) client_negotiation.cc:769] Sending connection context
0809 02:28:14.325595 (+ 217us) client_negotiation.cc:240] Negotiation successful
0809 02:28:14.325950 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1237,"thread_start_us":165,"threads_started":1}
I20260809 02:28:14.328666 8302 heartbeater.cc:347] Connected to a master server at 127.21.214.190:33005
I20260809 02:28:14.328948 8302 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:14.329543 8302 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
Aug 09 02:28:14 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242494, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:14.331631 8034 ts_manager.cc:194] Registered new tserver with Master: 8a259ef236054ed2bc400b24d3a19d23 (127.21.214.129:42385)
I20260809 02:28:14.333182 8034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:34457
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:28:14.365406 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.214.148:58209/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33005
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:14.493189 8309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:14.493682 8309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:14.493830 8309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:14.498764 8309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:14.498857 8309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:14.498971 8309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:28:14.506209 8309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.21.214.148:58209/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:14.507426 8309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:14.508519 8309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:14.518602 8317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:14.518581 8318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:14.518836 8321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:14.518920 8309 server_base.cc:1034] running on GCE node
I20260809 02:28:14.519670 8309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:14.520376 8309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:14.521603 8309 hybrid_clock.cc:648] HybridClock initialized: now 1786242494521567 us; error 46 us; skew 500 ppm
Aug 09 02:28:14 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242494, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:14.524679 8309 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:28:14.525885 8309 webserver.cc:460] Webserver started at http://127.21.214.130:44883/ using document root <none> and password file <none>
I20260809 02:28:14.526701 8309 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:14.526793 8309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:14.527097 8309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:28:14 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242494, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:28:14.543387 8309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "37dab894fe5f4477af5eea7dcb6fea2a"
format_stamp: "Formatted at 2026-08-09 02:28:14 on dist-test-slave-68xk"
server_key: "a330e517d1c6e5a6508edaf3f9948fe5"
server_key_iv: "d1a68fd2c8430ee2147aac2c21ddc442"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:14.544293 8309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "37dab894fe5f4477af5eea7dcb6fea2a"
format_stamp: "Formatted at 2026-08-09 02:28:14 on dist-test-slave-68xk"
server_key: "a330e517d1c6e5a6508edaf3f9948fe5"
server_key_iv: "d1a68fd2c8430ee2147aac2c21ddc442"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:14.550316 8309 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 02:28:14.569120 8330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:14.571074 8309 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:28:14.571303 8309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "37dab894fe5f4477af5eea7dcb6fea2a"
format_stamp: "Formatted at 2026-08-09 02:28:14 on dist-test-slave-68xk"
server_key: "a330e517d1c6e5a6508edaf3f9948fe5"
server_key_iv: "d1a68fd2c8430ee2147aac2c21ddc442"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:14.571545 8309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:14.611169 8309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:14.614535 8309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:14.614755 8309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:14.615459 8309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:14.616369 8309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:14.616444 8309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:14.616506 8309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:14.616544 8309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:14.632495 8309 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:42859
I20260809 02:28:14.633632 8309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:28:14.634943 8485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:42859 every 8 connection(s)
I20260809 02:28:14.637017 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 8309
I20260809 02:28:14.637152 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:28:14.637480 22362 external_mini_cluster.cc:1428] Setting key 891acf3dfbeccf8c7aa4f0d9d3bea5cf
Aug 09 02:28:14 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242494, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
I20260809 02:28:14.654106 8304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:14.638736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:42489 (local address 127.21.214.190:33005)
0809 02:28:14.638870 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:14.638875 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:14.641019 (+ 2144us) server_negotiation.cc:407] Connection header received
0809 02:28:14.641077 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:14.641082 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:14.641144 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:14.641237 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:14.642938 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:14.643790 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:14.645705 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:14.646119 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:14.646224 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:14.649661 (+ 3437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:14.649669 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:14.649675 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:14.649711 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:14.651602 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:14.652164 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:14.652195 (+ 31us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:14.652199 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:14.652296 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:14.652672 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:14.652676 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:14.652677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:14.652864 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:14.652985 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:14.653791 (+ 806us) server_negotiation.cc:299] Negotiation successful
0809 02:28:14.653929 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
I20260809 02:28:14.655205 8489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:14.637541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:33005 (local address 127.21.214.130:42489)
0809 02:28:14.639348 (+ 1807us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:14.639408 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:14.640637 (+ 1229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:14.641565 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:14.641577 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:14.641971 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:14.642747 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:14.642770 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:14.643960 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:14.643965 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:14.645545 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:14.645560 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:14.646469 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:14.646476 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:14.646718 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:14.647501 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:14.647530 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:14.649449 (+ 1919us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:14.651728 (+ 2279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:14.651732 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:14.651745 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:14.651996 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:14.652414 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:14.652416 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:14.652417 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:14.652550 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:14.652986 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:14.652994 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:14.653447 (+ 453us) client_negotiation.cc:769] Sending connection context
0809 02:28:14.653735 (+ 288us) client_negotiation.cc:240] Negotiation successful
0809 02:28:14.654056 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1582,"thread_start_us":188,"threads_started":1}
I20260809 02:28:14.656576 8486 heartbeater.cc:347] Connected to a master server at 127.21.214.190:33005
I20260809 02:28:14.656839 8486 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:14.657455 8486 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
I20260809 02:28:14.658694 8034 ts_manager.cc:194] Registered new tserver with Master: 37dab894fe5f4477af5eea7dcb6fea2a (127.21.214.130:42859)
I20260809 02:28:14.659446 8034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:42489
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:28:14.682711 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.214.148:58209/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33005
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:28:14 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242494, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
W20260809 02:28:14.845463 8494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:14.845870 8494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:14.845973 8494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:14.852818 8494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:14.852905 8494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:14.852989 8494 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:28:14.860710 8494 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.21.214.148:58209/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:14.862119 8494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:14.863472 8494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:14.876724 8501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:14.876950 8503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:14.877265 8505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:14.878358 8494 server_base.cc:1034] running on GCE node
I20260809 02:28:14.878865 8494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:14.879647 8494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:14.880856 8494 hybrid_clock.cc:648] HybridClock initialized: now 1786242494880785 us; error 84 us; skew 500 ppm
Aug 09 02:28:14 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242494, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:14.884545 8494 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:28:14.885661 8494 webserver.cc:460] Webserver started at http://127.21.214.131:34617/ using document root <none> and password file <none>
I20260809 02:28:14.886365 8494 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:14.886472 8494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:14.886711 8494 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 02:28:14 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242494, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:28:14.903945 8494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "e9f691f6a8424bc48ec0d85ef529fcd1"
format_stamp: "Formatted at 2026-08-09 02:28:14 on dist-test-slave-68xk"
server_key: "5f43dc299d1a71fe745172ac900ee3da"
server_key_iv: "8edf698ea26155c57966613d3c3eac1d"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:14.904826 8494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "e9f691f6a8424bc48ec0d85ef529fcd1"
format_stamp: "Formatted at 2026-08-09 02:28:14 on dist-test-slave-68xk"
server_key: "5f43dc299d1a71fe745172ac900ee3da"
server_key_iv: "8edf698ea26155c57966613d3c3eac1d"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:14.912854 8494 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.003s sys 0.004s
I20260809 02:28:14.940886 8517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:14.942584 8494 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260809 02:28:14.942750 8494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "e9f691f6a8424bc48ec0d85ef529fcd1"
format_stamp: "Formatted at 2026-08-09 02:28:14 on dist-test-slave-68xk"
server_key: "5f43dc299d1a71fe745172ac900ee3da"
server_key_iv: "8edf698ea26155c57966613d3c3eac1d"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:14.942905 8494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:14.966478 8494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:14.970167 8494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:14.970377 8494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:14.971110 8494 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:14.972154 8494 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:14.972218 8494 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:14.972272 8494 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:14.972303 8494 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:14.983537 8494 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:40663
I20260809 02:28:14.984687 8494 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:28:14.987257 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 8494
I20260809 02:28:14.987396 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:28:14.987746 22362 external_mini_cluster.cc:1428] Setting key 7569f603b7305bd45e7b5886ba24c9f0
I20260809 02:28:14.988086 8669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:40663 every 8 connection(s)
Aug 09 02:28:14 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242494, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:15.005828 8304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:14.991356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:58595 (local address 127.21.214.190:33005)
0809 02:28:14.991493 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:14.991497 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:14.992181 (+ 684us) server_negotiation.cc:407] Connection header received
0809 02:28:14.993453 (+ 1272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:14.993456 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:14.993510 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:14.993561 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:14.995223 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:14.996064 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:14.997772 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:14.998091 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:14.998172 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:15.001282 (+ 3110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:15.001286 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:15.001289 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:15.001319 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:15.003127 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:15.003773 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:15.003777 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:15.003779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:15.003868 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:15.004263 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:15.004267 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:15.004269 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:15.004494 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:15.004583 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:15.005418 (+ 835us) server_negotiation.cc:299] Negotiation successful
0809 02:28:15.005569 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 02:28:15.007788 8677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:14.990273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:33005 (local address 127.21.214.131:58595)
0809 02:28:14.992034 (+ 1761us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:14.992089 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:14.993206 (+ 1117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:14.993987 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:14.993996 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:14.994351 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:14.995057 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:14.995075 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:14.996227 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:14.996230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:14.997613 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:14.997624 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:14.998387 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:14.998391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:14.998601 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:14.999311 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:14.999332 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:15.001079 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:15.003272 (+ 2193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:15.003278 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:15.003295 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:15.003638 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:15.003975 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:15.003978 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:15.003980 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:15.004155 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:15.004662 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:15.004672 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:15.005077 (+ 405us) client_negotiation.cc:769] Sending connection context
0809 02:28:15.006083 (+ 1006us) client_negotiation.cc:240] Negotiation successful
0809 02:28:15.006510 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1551,"thread_start_us":181,"threads_started":1}
I20260809 02:28:15.009207 8672 heartbeater.cc:347] Connected to a master server at 127.21.214.190:33005
I20260809 02:28:15.009491 8672 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:15.010133 8672 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
I20260809 02:28:15.011332 8034 ts_manager.cc:194] Registered new tserver with Master: e9f691f6a8424bc48ec0d85ef529fcd1 (127.21.214.131:40663)
I20260809 02:28:15.012117 8034 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:58595
I20260809 02:28:15.013712 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:28:15.014681 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 8138
I20260809 02:28:15.052263 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 8309
I20260809 02:28:15.062698 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 8494
I20260809 02:28:15.078068 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 7998
I20260809 02:28:15.093796 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:33005
--webserver_interface=127.21.214.190
--webserver_port=36147
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:33005
--ranger_config_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.214.148:58209/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.21.214.148:58209/kms with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:15.233801 8678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:15.234108 8678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:15.234233 8678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:15.238802 8678 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:28:15.238889 8678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:15.238931 8678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:15.238996 8678 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:28:15.239038 8678 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:28:15.245003 8678 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.21.214.148:58209/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:33005
--ranger_config_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:33005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=36147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:15.246088 8678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:15.247272 8678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:15.256383 8686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:15.256551 8678 server_base.cc:1034] running on GCE node
W20260809 02:28:15.256395 8688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:15.256409 8685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:15.257222 8678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:15.258337 8678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:15.259510 8678 hybrid_clock.cc:648] HybridClock initialized: now 1786242495259475 us; error 48 us; skew 500 ppm
Aug 09 02:28:15 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242495, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:15.262583 8678 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:28:15.263550 8678 webserver.cc:460] Webserver started at http://127.21.214.190:36147/ using document root <none> and password file <none>
I20260809 02:28:15.264144 8678 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:15.264254 8678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:28:15 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242495, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:28:15.311987 8678 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:28:15.314713 8700 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:15.316165 8678 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:28:15.316363 8678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "fe180f4defe54a02b0b897c6c6e24518"
format_stamp: "Formatted at 2026-08-09 02:28:13 on dist-test-slave-68xk"
server_key: "b14b1b6784c8f66b1554d1b62011c2c5"
server_key_iv: "30ba467e6034b9d0b2644131c22fd9b4"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:15.317005 8678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:15.338150 8678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:15.341274 8678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:15.341500 8678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:15.349723 8678 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:33005
I20260809 02:28:15.349735 8781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:33005 every 8 connection(s)
I20260809 02:28:15.350878 8678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:28:15.354554 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 8678
I20260809 02:28:15.355129 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.214.148:58209/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:42385
--local_ip_for_outbound_sockets=127.21.214.129
--tserver_master_addrs=127.21.214.190:33005
--webserver_port=40657
--webserver_interface=127.21.214.129
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.21.214.148:58209/kms with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:28:15.355984 8783 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:28:15.358299 8783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518: Bootstrap starting.
I20260809 02:28:15.376924 8783 log.cc:824] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:15.384285 8783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:28:15.384752 8783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518: Bootstrap complete.
I20260809 02:28:15.389503 8783 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe180f4defe54a02b0b897c6c6e24518" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33005 } }
I20260809 02:28:15.389932 8783 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe180f4defe54a02b0b897c6c6e24518, State: Initialized, Role: FOLLOWER
I20260809 02:28:15.390590 8783 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe180f4defe54a02b0b897c6c6e24518" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33005 } }
I20260809 02:28:15.390722 8783 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:28:15.390815 8783 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:28:15.390913 8783 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:28:15.392908 8783 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe180f4defe54a02b0b897c6c6e24518" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33005 } }
I20260809 02:28:15.393267 8783 leader_election.cc:302] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe180f4defe54a02b0b897c6c6e24518; no voters:
I20260809 02:28:15.393613 8783 leader_election.cc:288] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:28:15.393765 8788 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:28:15.394052 8788 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [term 2 LEADER]: Becoming Leader. State: Replica: fe180f4defe54a02b0b897c6c6e24518, State: Running, Role: LEADER
I20260809 02:28:15.394532 8788 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe180f4defe54a02b0b897c6c6e24518" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33005 } }
I20260809 02:28:15.395004 8783 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:28:15.396202 8790 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe180f4defe54a02b0b897c6c6e24518. Latest consensus state: current_term: 2 leader_uuid: "fe180f4defe54a02b0b897c6c6e24518" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe180f4defe54a02b0b897c6c6e24518" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33005 } } }
I20260809 02:28:15.396337 8790 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:15.396611 8789 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fe180f4defe54a02b0b897c6c6e24518" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe180f4defe54a02b0b897c6c6e24518" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33005 } } }
I20260809 02:28:15.396695 8789 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518 [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:15.396752 8801 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:28:15.400345 8801 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:28:15.400921 8783 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 02:28:15.401221 8801 catalog_manager.cc:1259] Loaded cluster ID: 606e98bc24c744d6ad14d9f8faeee15e
I20260809 02:28:15.401331 8801 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:28:15.407835 8801 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:28:15.409523 8801 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518: Loaded TSK: 0
I20260809 02:28:15.412096 8801 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:28:15.518934 8786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:15.519305 8786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:15.519382 8786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:15.526480 8786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:15.526634 8786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:15.526795 8786 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:28:15.535670 8786 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.21.214.148:58209/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:42385
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=40657
--tserver_master_addrs=127.21.214.190:33005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:15.537088 8786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:15.538630 8786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:15.551986 8832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:15.552178 8833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:15.552503 8838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:15.553194 8786 server_base.cc:1034] running on GCE node
I20260809 02:28:15.553658 8786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:15.554563 8786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:15.555761 8786 hybrid_clock.cc:648] HybridClock initialized: now 1786242495555733 us; error 46 us; skew 500 ppm
Aug 09 02:28:15 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242495, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:15.559394 8786 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:28:15.560412 8786 webserver.cc:460] Webserver started at http://127.21.214.129:40657/ using document root <none> and password file <none>
I20260809 02:28:15.561124 8786 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:15.561267 8786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:28:15 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242495, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:28:15.592852 8786 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.002s sys 0.000s
I20260809 02:28:15.596148 8850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:15.597822 8786 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:28:15.597965 8786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "8a259ef236054ed2bc400b24d3a19d23"
format_stamp: "Formatted at 2026-08-09 02:28:14 on dist-test-slave-68xk"
server_key: "a0a692aa918424f5d63e63c8d427c695"
server_key_iv: "cac55f28eb67d5625e8fc505368fcb28"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:15.598733 8786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:15.623690 8786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:15.627465 8786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:15.627696 8786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:15.628441 8786 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:15.629536 8786 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:15.629618 8786 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:15.629678 8786 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:15.629710 8786 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:15.641271 8786 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:42385
I20260809 02:28:15.641410 9002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:42385 every 8 connection(s)
I20260809 02:28:15.642326 8786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:28:15.648280 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 8786
I20260809 02:28:15.648803 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.214.148:58209/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:42859
--local_ip_for_outbound_sockets=127.21.214.130
--tserver_master_addrs=127.21.214.190:33005
--webserver_port=44883
--webserver_interface=127.21.214.130
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.21.214.148:58209/kms with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:28:15 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242495, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:15.662274 9013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:15.644707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:33005 (local address 127.21.214.129:53419)
0809 02:28:15.645730 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:15.645770 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:15.646677 (+ 907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:15.647865 (+ 1188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:15.647873 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:15.648207 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:15.648665 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:15.648680 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:15.650150 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:15.650158 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:15.651436 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:15.651447 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:15.652741 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:15.652745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:15.652936 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:15.653655 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:15.653683 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:15.655421 (+ 1738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:15.658270 (+ 2849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:15.658277 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:15.658291 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:15.658702 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:15.659168 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:15.659171 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:15.659173 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:15.659356 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:15.660241 (+ 885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:15.660246 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:15.660568 (+ 322us) client_negotiation.cc:769] Sending connection context
0809 02:28:15.660791 (+ 223us) client_negotiation.cc:240] Negotiation successful
0809 02:28:15.661167 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":861,"thread_start_us":137,"threads_started":1}
I20260809 02:28:15.664503 9008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:15.644587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:53419 (local address 127.21.214.190:33005)
0809 02:28:15.645254 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:15.645276 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:15.645912 (+ 636us) server_negotiation.cc:407] Connection header received
0809 02:28:15.647126 (+ 1214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:15.647136 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:15.647460 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:15.647791 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:15.648837 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:15.650008 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:15.651596 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:15.652319 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:15.652498 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:15.655642 (+ 3144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:15.655648 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:15.655660 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:15.655689 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:15.658110 (+ 2421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:15.658858 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:15.658864 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:15.658870 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:15.659017 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:15.659496 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:15.659499 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:15.659501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:15.660011 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:15.660171 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:15.663266 (+ 3095us) server_negotiation.cc:299] Negotiation successful
0809 02:28:15.663579 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":123,"threads_started":1}
I20260809 02:28:15.668578 9004 heartbeater.cc:347] Connected to a master server at 127.21.214.190:33005
I20260809 02:28:15.668859 9004 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:15.669404 9004 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
W20260809 02:28:15.671653 9004 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:33005 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 02:28:15.671777 9004 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:15.671940 9004 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
I20260809 02:28:15.672849 9004 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:15.673014 9004 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
W20260809 02:28:15.673810 9004 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:28:15.822026 9014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:15.822474 9014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:15.822564 9014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:15.828842 9014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:15.828930 9014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:15.829022 9014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:28:15.837270 9014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.21.214.148:58209/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:42859
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=44883
--tserver_master_addrs=127.21.214.190:33005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:15.838850 9014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:15.840337 9014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:15.853765 9019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:15.853767 9022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:15.853772 9020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:15.854497 9014 server_base.cc:1034] running on GCE node
I20260809 02:28:15.855173 9014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:15.855973 9014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:15.857187 9014 hybrid_clock.cc:648] HybridClock initialized: now 1786242495857150 us; error 53 us; skew 500 ppm
Aug 09 02:28:15 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242495, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:15.860456 9014 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:28:15.861728 9014 webserver.cc:460] Webserver started at http://127.21.214.130:44883/ using document root <none> and password file <none>
I20260809 02:28:15.862515 9014 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:15.862635 9014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:28:15 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242495, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:28:15.887079 9014 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260809 02:28:15.890475 9031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:15.891999 9014 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:28:15.892169 9014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "37dab894fe5f4477af5eea7dcb6fea2a"
format_stamp: "Formatted at 2026-08-09 02:28:14 on dist-test-slave-68xk"
server_key: "a330e517d1c6e5a6508edaf3f9948fe5"
server_key_iv: "d1a68fd2c8430ee2147aac2c21ddc442"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:15.892812 9014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:15.923136 9014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:15.927850 9014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:15.928164 9014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:15.929044 9014 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:15.930290 9014 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:15.930364 9014 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:15.930539 9014 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:15.930585 9014 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:15.944077 9014 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:42859
I20260809 02:28:15.944234 9184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:42859 every 8 connection(s)
I20260809 02:28:15.945487 9014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:28:15.945796 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 9014
I20260809 02:28:15.946326 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.21.214.148:58209/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:40663
--local_ip_for_outbound_sockets=127.21.214.131
--tserver_master_addrs=127.21.214.190:33005
--webserver_port=34617
--webserver_interface=127.21.214.131
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:46183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.21.214.148:58209/kms with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:28:15 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242495, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:15.966459 9188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:15.948842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:33005 (local address 127.21.214.130:41681)
0809 02:28:15.950928 (+ 2086us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:15.950985 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:15.952189 (+ 1204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:15.953009 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:15.953019 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:15.953415 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:15.954101 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:15.954120 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:15.955368 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:15.955371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:15.956818 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:15.956829 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:15.957716 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:15.957720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:15.957921 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:15.958659 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:15.958682 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:15.960463 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:15.962609 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:15.962619 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:15.962640 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:15.963044 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:15.963450 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:15.963456 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:15.963460 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:15.963676 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:15.964261 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:15.964271 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:15.964644 (+ 373us) client_negotiation.cc:769] Sending connection context
0809 02:28:15.964895 (+ 251us) client_negotiation.cc:240] Negotiation successful
0809 02:28:15.965323 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1862,"thread_start_us":153,"threads_started":1}
I20260809 02:28:15.967398 9008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:15.950001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:41681 (local address 127.21.214.190:33005)
0809 02:28:15.950142 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:15.950147 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:15.951105 (+ 958us) server_negotiation.cc:407] Connection header received
0809 02:28:15.952459 (+ 1354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:15.952462 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:15.952525 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:15.952581 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:15.954291 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:15.955199 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:15.956993 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:15.957405 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:15.957524 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:15.960683 (+ 3159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:15.960686 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:15.960688 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:15.960738 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:15.962452 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:15.963195 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:15.963201 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:15.963205 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:15.963307 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:15.963803 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:15.963810 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:15.963813 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:15.964068 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:15.964190 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:15.967066 (+ 2876us) server_negotiation.cc:299] Negotiation successful
0809 02:28:15.967243 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:28:15.968453 9185 heartbeater.cc:347] Connected to a master server at 127.21.214.190:33005
I20260809 02:28:15.968712 9185 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:15.969305 9185 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
W20260809 02:28:15.970963 9185 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:33005 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 02:28:15.971113 9185 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:15.971308 9185 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
I20260809 02:28:15.972090 9185 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:15.972285 9185 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
W20260809 02:28:15.973140 9185 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:28:16.091111 9187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:16.091378 9187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:16.091420 9187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:16.097033 9187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:16.097118 9187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:16.097273 9187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:28:16.105088 9187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:46183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.21.214.148:58209/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:40663
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=34617
--tserver_master_addrs=127.21.214.190:33005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:16.106660 9187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:16.108023 9187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:16.120376 9204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:16.121299 9198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:16.121542 9187 server_base.cc:1034] running on GCE node
W20260809 02:28:16.122578 9197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:16.123083 9187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:16.123860 9187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:16.125072 9187 hybrid_clock.cc:648] HybridClock initialized: now 1786242496125032 us; error 56 us; skew 500 ppm
Aug 09 02:28:16 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242496, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:16.128099 9187 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:28:16.129117 9187 webserver.cc:460] Webserver started at http://127.21.214.131:34617/ using document root <none> and password file <none>
I20260809 02:28:16.129705 9187 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:16.129825 9187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 02:28:16 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242496, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:28:16.147500 9187 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.000s
I20260809 02:28:16.150892 9217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:16.152647 9187 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 02:28:16.152786 9187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "e9f691f6a8424bc48ec0d85ef529fcd1"
format_stamp: "Formatted at 2026-08-09 02:28:14 on dist-test-slave-68xk"
server_key: "5f43dc299d1a71fe745172ac900ee3da"
server_key_iv: "8edf698ea26155c57966613d3c3eac1d"
server_key_version: "kuduclusterkey@0"
I20260809 02:28:16.153515 9187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:16.188342 9187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:16.191982 9187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:16.192207 9187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:16.192905 9187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:16.193953 9187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:16.194029 9187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:16.194113 9187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:16.194147 9187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:16.205911 9187 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:40663
I20260809 02:28:16.207257 9187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:28:16.207484 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 9187
I20260809 02:28:16.213270 9372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:40663 every 8 connection(s)
Aug 09 02:28:16 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242496, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:16.220057 9008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:16.208307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54798 (local address 127.21.214.190:33005)
0809 02:28:16.208467 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:16.208472 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:16.211158 (+ 2686us) server_negotiation.cc:407] Connection header received
0809 02:28:16.211317 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:16.211320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:16.211372 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:16.211462 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:16.212403 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:16.213036 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:16.214252 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:16.214576 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:16.214687 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:16.216416 (+ 1729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:16.216420 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:16.216423 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:16.216449 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:16.218272 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:16.218764 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:16.218768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:16.218769 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:16.218854 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:16.219142 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:16.219146 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:16.219148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:16.219392 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:16.219611 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:16.219769 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 02:28:16.219894 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:28:16.224001 9377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:16.210870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:44263 (local address 127.21.214.190:33005)
0809 02:28:16.212428 (+ 1558us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:16.212432 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:16.212443 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:28:16.212474 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:16.212476 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:16.212519 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:16.212614 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:16.214071 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:16.214687 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:16.216458 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:16.216703 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:16.217140 (+ 437us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:16.219828 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:16.219832 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:16.219836 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:16.219864 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:16.221857 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:16.222481 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:16.222484 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:16.222486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:16.222572 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:16.222955 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:16.222958 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:16.222959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:16.223117 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:16.223197 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:16.223788 (+ 591us) server_negotiation.cc:299] Negotiation successful
0809 02:28:16.223883 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":96,"threads_started":1}
I20260809 02:28:16.225083 9376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:16.209793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:33005 (local address 127.21.214.131:44263)
0809 02:28:16.210353 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:16.210445 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:16.211481 (+ 1036us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:16.212864 (+ 1383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:16.212874 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:16.213233 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:16.213916 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:16.213931 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:16.214843 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:16.214846 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:16.216342 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:16.216357 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:16.217181 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:16.217188 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:16.217394 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:16.217913 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:16.217933 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:16.219628 (+ 1695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:16.222005 (+ 2377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:16.222011 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:16.222028 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:16.222363 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:16.222676 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:16.222680 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:16.222682 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:16.222855 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:16.223219 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:16.223226 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:16.223517 (+ 291us) client_negotiation.cc:769] Sending connection context
0809 02:28:16.223739 (+ 222us) client_negotiation.cc:240] Negotiation successful
0809 02:28:16.224053 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":150,"threads_started":1}
I20260809 02:28:16.226820 9373 heartbeater.cc:347] Connected to a master server at 127.21.214.190:33005
I20260809 02:28:16.227075 9373 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:16.227566 9373 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
W20260809 02:28:16.229089 9373 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:33005 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 02:28:16.229219 9373 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:16.229384 9373 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
I20260809 02:28:16.230461 9373 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:16.230700 9373 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
W20260809 02:28:16.231575 9373 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 02:28:16 dist-test-slave-68xk krb5kdc[7408](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786242496, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:16.674068 9004 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:16.674455 9004 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
I20260809 02:28:16.675751 8734 ts_manager.cc:194] Registered new tserver with Master: 8a259ef236054ed2bc400b24d3a19d23 (127.21.214.129:42385)
I20260809 02:28:16.677623 8734 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:53419
I20260809 02:28:16.973379 9185 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:16.973692 9185 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
I20260809 02:28:16.974514 8734 ts_manager.cc:194] Registered new tserver with Master: 37dab894fe5f4477af5eea7dcb6fea2a (127.21.214.130:42859)
I20260809 02:28:16.975344 8734 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:41681
Aug 09 02:28:16 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242496, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:28:17.231805 9373 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:17.232173 9373 heartbeater.cc:511] Master 127.21.214.190:33005 requested a full tablet report, sending...
I20260809 02:28:17.232977 8734 ts_manager.cc:194] Registered new tserver with Master: e9f691f6a8424bc48ec0d85ef529fcd1 (127.21.214.131:40663)
I20260809 02:28:17.233767 8734 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:44263
Aug 09 02:28:17 dist-test-slave-68xk krb5kdc[7408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242496, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for HTTP/127.21.214.148@KRBTEST.COM
I20260809 02:28:17.237545 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:28:17.257965 9403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:17.240325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54804 (local address 127.21.214.190:33005)
0809 02:28:17.240911 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:17.240916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:17.245268 (+ 4352us) server_negotiation.cc:407] Connection header received
0809 02:28:17.245487 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:17.245490 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:17.245560 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:17.245629 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:17.246663 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.247457 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.248655 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.249031 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.249115 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:17.253914 (+ 4799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:17.253918 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:17.253921 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:17.253949 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:17.255922 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:17.256441 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:17.256444 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:17.256446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:17.256551 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:17.256931 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:17.256937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:17.256940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:17.257144 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:17.257290 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:17.257540 (+ 250us) server_negotiation.cc:299] Negotiation successful
0809 02:28:17.257678 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":92,"threads_started":1}
I20260809 02:28:17.262241 8734 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:28:17.267093 8734 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:28:17.303170 9420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:17.294592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:42385 (local address 127.0.0.1:41208)
0809 02:28:17.296965 (+ 2373us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:17.296976 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:17.297061 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:17.297819 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:17.297827 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:17.297853 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:17.297997 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:17.298004 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.299903 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.299906 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:17.301300 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:17.301313 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.302626 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.302630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:17.302740 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:17.302776 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 02:28:17.302883 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 02:28:17.302995 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2318,"thread_start_us":95,"threads_started":1}
I20260809 02:28:17.304198 9419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:17.295026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41208 (local address 127.21.214.129:42385)
0809 02:28:17.296343 (+ 1317us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:17.296350 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:17.297149 (+ 799us) server_negotiation.cc:407] Connection header received
0809 02:28:17.297238 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:17.297243 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:17.297448 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:17.297591 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:17.298153 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.299777 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.301512 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.302290 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.302426 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:17.302561 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:17.303939 (+ 1378us) server_negotiation.cc:299] Negotiation successful
0809 02:28:17.304058 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1203,"thread_start_us":136,"threads_started":1}
I20260809 02:28:17.307794 8920 tablet_service.cc:1467] Processing CreateTablet for tablet be1e5614871c466787704cdeac2d5c9e (DEFAULT_TABLE table=test-table [id=f2184646ca6c4d29a716ba4f0371c0c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:28:17.308998 8920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be1e5614871c466787704cdeac2d5c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:17.310446 9418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:17.293516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:40663 (local address 127.0.0.1:52760)
0809 02:28:17.296584 (+ 3068us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:17.296636 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:17.296762 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:17.306033 (+ 9271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:17.306036 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:17.306069 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:17.306156 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:17.306161 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.307700 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.307703 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:17.308850 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:17.308863 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.310027 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.310031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:17.310133 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:17.310161 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 02:28:17.310213 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 02:28:17.310284 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2900,"thread_start_us":101,"threads_started":1}
I20260809 02:28:17.311381 9416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:17.293649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52760 (local address 127.21.214.131:40663)
0809 02:28:17.305575 (+ 11926us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:17.305582 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:17.305608 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:28:17.305685 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:17.305690 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:17.305876 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:17.306312 (+ 436us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:17.306481 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.307561 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.309018 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.309880 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.310939 (+ 1059us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:17.311093 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:17.311148 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 02:28:17.311243 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11810,"thread_start_us":92,"threads_started":1}
I20260809 02:28:17.314553 9281 tablet_service.cc:1467] Processing CreateTablet for tablet be1e5614871c466787704cdeac2d5c9e (DEFAULT_TABLE table=test-table [id=f2184646ca6c4d29a716ba4f0371c0c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:28:17.315033 9414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:17.295797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:42859 (local address 127.0.0.1:37336)
0809 02:28:17.298996 (+ 3199us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:17.299011 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:17.299119 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:17.303390 (+ 4271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:17.303393 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:17.303414 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:17.303516 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:17.303523 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.312056 (+ 8533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.312060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:17.313276 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:17.313290 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.314598 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.314602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:17.314705 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:17.314734 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 02:28:17.314793 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 02:28:17.314868 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3134,"thread_start_us":111,"threads_started":1}
I20260809 02:28:17.315672 9281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be1e5614871c466787704cdeac2d5c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:17.315724 9421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:17.295990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37336 (local address 127.21.214.130:42859)
0809 02:28:17.302661 (+ 6671us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:17.302669 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:17.302700 (+ 31us) server_negotiation.cc:407] Connection header received
0809 02:28:17.302785 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:17.302791 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:17.303040 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:17.303212 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:17.310520 (+ 7308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.311872 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.313470 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.314392 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.315278 (+ 886us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:17.315422 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:17.315477 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 02:28:17.315584 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6532,"thread_start_us":113,"threads_started":1}
I20260809 02:28:17.320541 9078 tablet_service.cc:1467] Processing CreateTablet for tablet be1e5614871c466787704cdeac2d5c9e (DEFAULT_TABLE table=test-table [id=f2184646ca6c4d29a716ba4f0371c0c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:28:17.321671 9078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be1e5614871c466787704cdeac2d5c9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:17.340274 9422 tablet_bootstrap.cc:492] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23: Bootstrap starting.
I20260809 02:28:17.343170 9422 tablet_bootstrap.cc:654] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:17.343640 9427 tablet_bootstrap.cc:492] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a: Bootstrap starting.
I20260809 02:28:17.344079 9424 tablet_bootstrap.cc:492] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1: Bootstrap starting.
I20260809 02:28:17.346552 9427 tablet_bootstrap.cc:654] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:17.348786 9424 tablet_bootstrap.cc:654] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:17.349821 9422 log.cc:824] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:17.350814 9424 log.cc:824] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:17.351733 9427 log.cc:824] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:17.355674 9427 tablet_bootstrap.cc:492] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a: No bootstrap required, opened a new log
I20260809 02:28:17.355687 9422 tablet_bootstrap.cc:492] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23: No bootstrap required, opened a new log
I20260809 02:28:17.355911 9422 ts_tablet_manager.cc:1397] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.001s
I20260809 02:28:17.355949 9427 ts_tablet_manager.cc:1397] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.004s
I20260809 02:28:17.360674 9422 raft_consensus.cc:348] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f691f6a8424bc48ec0d85ef529fcd1" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40663 } } peers { permanent_uuid: "8a259ef236054ed2bc400b24d3a19d23" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42385 } } peers { permanent_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42859 } }
I20260809 02:28:17.361155 9422 raft_consensus.cc:374] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:17.361267 9422 raft_consensus.cc:729] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a259ef236054ed2bc400b24d3a19d23, State: Initialized, Role: FOLLOWER
I20260809 02:28:17.361882 9422 consensus_queue.cc:260] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f691f6a8424bc48ec0d85ef529fcd1" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40663 } } peers { permanent_uuid: "8a259ef236054ed2bc400b24d3a19d23" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42385 } } peers { permanent_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42859 } }
I20260809 02:28:17.362192 9424 tablet_bootstrap.cc:492] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1: No bootstrap required, opened a new log
I20260809 02:28:17.362520 9424 ts_tablet_manager.cc:1397] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.000s
I20260809 02:28:17.363198 9422 ts_tablet_manager.cc:1428] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20260809 02:28:17.363651 9004 heartbeater.cc:503] Master 127.21.214.190:33005 was elected leader, sending a full tablet report...
I20260809 02:28:17.366765 9424 raft_consensus.cc:348] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f691f6a8424bc48ec0d85ef529fcd1" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40663 } } peers { permanent_uuid: "8a259ef236054ed2bc400b24d3a19d23" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42385 } } peers { permanent_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42859 } }
I20260809 02:28:17.367537 9427 raft_consensus.cc:348] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f691f6a8424bc48ec0d85ef529fcd1" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40663 } } peers { permanent_uuid: "8a259ef236054ed2bc400b24d3a19d23" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42385 } } peers { permanent_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42859 } }
I20260809 02:28:17.367843 9427 raft_consensus.cc:374] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:17.367954 9427 raft_consensus.cc:729] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37dab894fe5f4477af5eea7dcb6fea2a, State: Initialized, Role: FOLLOWER
I20260809 02:28:17.368444 9427 consensus_queue.cc:260] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f691f6a8424bc48ec0d85ef529fcd1" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40663 } } peers { permanent_uuid: "8a259ef236054ed2bc400b24d3a19d23" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42385 } } peers { permanent_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42859 } }
I20260809 02:28:17.368671 9424 raft_consensus.cc:374] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:17.369392 9185 heartbeater.cc:503] Master 127.21.214.190:33005 was elected leader, sending a full tablet report...
I20260809 02:28:17.369782 9427 ts_tablet_manager.cc:1428] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260809 02:28:17.369874 9424 raft_consensus.cc:729] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9f691f6a8424bc48ec0d85ef529fcd1, State: Initialized, Role: FOLLOWER
I20260809 02:28:17.370363 9424 consensus_queue.cc:260] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f691f6a8424bc48ec0d85ef529fcd1" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40663 } } peers { permanent_uuid: "8a259ef236054ed2bc400b24d3a19d23" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42385 } } peers { permanent_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42859 } }
I20260809 02:28:17.371474 9424 ts_tablet_manager.cc:1428] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260809 02:28:17.371857 9373 heartbeater.cc:503] Master 127.21.214.190:33005 was elected leader, sending a full tablet report...
W20260809 02:28:17.394878 9006 tablet.cc:2369] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:28:17.423926 9436 raft_consensus.cc:482] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:28:17.424222 9436 raft_consensus.cc:504] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f691f6a8424bc48ec0d85ef529fcd1" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40663 } } peers { permanent_uuid: "8a259ef236054ed2bc400b24d3a19d23" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42385 } } peers { permanent_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42859 } }
I20260809 02:28:17.425827 9436 leader_election.cc:288] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9f691f6a8424bc48ec0d85ef529fcd1 (127.21.214.131:40663), 8a259ef236054ed2bc400b24d3a19d23 (127.21.214.129:42385)
I20260809 02:28:17.432626 9419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:17.426969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:53771 (local address 127.21.214.129:42385)
0809 02:28:17.427121 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:17.427126 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:17.427669 (+ 543us) server_negotiation.cc:407] Connection header received
0809 02:28:17.427861 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:17.427865 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:17.427913 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:17.427965 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:17.428455 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.429317 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.431155 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.431811 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.431914 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:17.431972 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:17.432391 (+ 419us) server_negotiation.cc:299] Negotiation successful
0809 02:28:17.432480 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:28:17.433204 9439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:17.426260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:42385 (local address 127.21.214.130:53771)
0809 02:28:17.427584 (+ 1324us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:17.427597 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:17.427738 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:17.428126 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:17.428129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:17.428148 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:17.428309 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:17.428316 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.429484 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.429488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:17.430978 (+ 1490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:17.430990 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.432095 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.432099 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:17.432234 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:17.432259 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:28:17.432904 (+ 645us) client_negotiation.cc:240] Negotiation successful
0809 02:28:17.433002 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1258,"thread_start_us":156,"threads_started":1}
I20260809 02:28:17.433911 8922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be1e5614871c466787704cdeac2d5c9e" candidate_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a259ef236054ed2bc400b24d3a19d23" is_pre_election: true
I20260809 02:28:17.434259 8922 raft_consensus.cc:2454] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37dab894fe5f4477af5eea7dcb6fea2a in term 0.
I20260809 02:28:17.434801 9035 leader_election.cc:302] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37dab894fe5f4477af5eea7dcb6fea2a, 8a259ef236054ed2bc400b24d3a19d23; no voters:
I20260809 02:28:17.435118 9436 raft_consensus.cc:2781] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:28:17.435196 9436 raft_consensus.cc:482] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:28:17.435237 9436 raft_consensus.cc:3037] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:17.436026 9416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:17.426564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:55959 (local address 127.21.214.131:40663)
0809 02:28:17.426691 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:17.426696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:17.427317 (+ 621us) server_negotiation.cc:407] Connection header received
0809 02:28:17.427475 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:17.427478 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:17.427530 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:17.427612 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:17.432185 (+ 4573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.432949 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.434619 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.435264 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.435372 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:17.435423 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:17.435819 (+ 396us) server_negotiation.cc:299] Negotiation successful
0809 02:28:17.435903 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:28:17.436450 9438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:17.426061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:40663 (local address 127.21.214.130:55959)
0809 02:28:17.427219 (+ 1158us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:17.427236 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:17.427370 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:17.431884 (+ 4514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:17.431888 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:17.431909 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:17.432021 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:17.432027 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.433093 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.433098 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:17.434401 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:17.434442 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.435536 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.435540 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:17.435666 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:17.435690 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:28:17.436226 (+ 536us) client_negotiation.cc:240] Negotiation successful
0809 02:28:17.436303 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1077,"thread_start_us":144,"threads_started":1}
I20260809 02:28:17.437091 9436 raft_consensus.cc:504] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f691f6a8424bc48ec0d85ef529fcd1" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40663 } } peers { permanent_uuid: "8a259ef236054ed2bc400b24d3a19d23" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42385 } } peers { permanent_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42859 } }
I20260809 02:28:17.437971 9292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be1e5614871c466787704cdeac2d5c9e" candidate_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9f691f6a8424bc48ec0d85ef529fcd1" is_pre_election: true
I20260809 02:28:17.438277 9292 raft_consensus.cc:2454] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37dab894fe5f4477af5eea7dcb6fea2a in term 0.
I20260809 02:28:17.439255 9436 leader_election.cc:288] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [CANDIDATE]: Term 1 election: Requested vote from peers e9f691f6a8424bc48ec0d85ef529fcd1 (127.21.214.131:40663), 8a259ef236054ed2bc400b24d3a19d23 (127.21.214.129:42385)
I20260809 02:28:17.440099 9292 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be1e5614871c466787704cdeac2d5c9e" candidate_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9f691f6a8424bc48ec0d85ef529fcd1"
I20260809 02:28:17.440234 9292 raft_consensus.cc:3037] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:17.441604 9292 raft_consensus.cc:2454] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37dab894fe5f4477af5eea7dcb6fea2a in term 1.
I20260809 02:28:17.441893 8922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be1e5614871c466787704cdeac2d5c9e" candidate_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a259ef236054ed2bc400b24d3a19d23"
I20260809 02:28:17.441941 9036 leader_election.cc:302] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37dab894fe5f4477af5eea7dcb6fea2a, e9f691f6a8424bc48ec0d85ef529fcd1; no voters:
I20260809 02:28:17.442039 8922 raft_consensus.cc:3037] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:17.442128 9436 raft_consensus.cc:2781] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:28:17.442350 9436 raft_consensus.cc:686] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [term 1 LEADER]: Becoming Leader. State: Replica: 37dab894fe5f4477af5eea7dcb6fea2a, State: Running, Role: LEADER
I20260809 02:28:17.442720 9436 consensus_queue.cc:237] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f691f6a8424bc48ec0d85ef529fcd1" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40663 } } peers { permanent_uuid: "8a259ef236054ed2bc400b24d3a19d23" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42385 } } peers { permanent_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42859 } }
I20260809 02:28:17.443506 8922 raft_consensus.cc:2454] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37dab894fe5f4477af5eea7dcb6fea2a in term 1.
I20260809 02:28:17.446127 8734 catalog_manager.cc:5495] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 37dab894fe5f4477af5eea7dcb6fea2a (127.21.214.130). New cstate: current_term: 1 leader_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9f691f6a8424bc48ec0d85ef529fcd1" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8a259ef236054ed2bc400b24d3a19d23" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37dab894fe5f4477af5eea7dcb6fea2a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42859 } health_report { overall_health: HEALTHY } } }
W20260809 02:28:17.451763 9186 tablet.cc:2369] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:28:17.464802 9374 tablet.cc:2369] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:28:17.468644 9421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:17.462880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37344 (local address 127.21.214.130:42859)
0809 02:28:17.463021 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:17.463027 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:17.463046 (+ 19us) server_negotiation.cc:407] Connection header received
0809 02:28:17.463131 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:17.463134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:17.463207 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:17.463336 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:28:17.463643 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.464469 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.466622 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:17.466962 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:17.467086 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:17.467459 (+ 373us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:28:17.467969 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:28:17.468103 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:17.468423 (+ 320us) server_negotiation.cc:299] Negotiation successful
0809 02:28:17.468491 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:28:17.479060 8922 raft_consensus.cc:1261] T be1e5614871c466787704cdeac2d5c9e P 8a259ef236054ed2bc400b24d3a19d23 [term 1 FOLLOWER]: Refusing update from remote peer 37dab894fe5f4477af5eea7dcb6fea2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:28:17.480002 9436 consensus_queue.cc:1035] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a259ef236054ed2bc400b24d3a19d23" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 42385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:28:17.486886 9292 raft_consensus.cc:1261] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1 [term 1 FOLLOWER]: Refusing update from remote peer 37dab894fe5f4477af5eea7dcb6fea2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:28:17.487665 9436 consensus_queue.cc:1035] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9f691f6a8424bc48ec0d85ef529fcd1" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:28:17.498587 9445 mvcc.cc:205] Tried to move back new op lower bound from 7316449269664104448 to 7316449269528612864. Current Snapshot: MvccSnapshot[applied={T|T < 7316449269664104448}]
I20260809 02:28:17.498831 9446 mvcc.cc:205] Tried to move back new op lower bound from 7316449269664104448 to 7316449269528612864. Current Snapshot: MvccSnapshot[applied={T|T < 7316449269664104448}]
I20260809 02:28:17.502003 9450 mvcc.cc:205] Tried to move back new op lower bound from 7316449269664104448 to 7316449269528612864. Current Snapshot: MvccSnapshot[applied={T|T < 7316449269664104448}]
I20260809 02:28:17.511230 8734 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:28:17.511425 8734 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:28:17.514194 8734 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe180f4defe54a02b0b897c6c6e24518: Sending DeleteTablet for 3 replicas of tablet be1e5614871c466787704cdeac2d5c9e
I20260809 02:28:17.515066 9281 tablet_service.cc:1514] Processing DeleteTablet for tablet be1e5614871c466787704cdeac2d5c9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:17 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:52760
I20260809 02:28:17.515297 8920 tablet_service.cc:1514] Processing DeleteTablet for tablet be1e5614871c466787704cdeac2d5c9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:17 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:41208
I20260809 02:28:17.515944 9078 tablet_service.cc:1514] Processing DeleteTablet for tablet be1e5614871c466787704cdeac2d5c9e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:17 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:37336
I20260809 02:28:17.516382 9463 tablet_replica.cc:330] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a: stopping tablet replica
I20260809 02:28:17.516685 9463 raft_consensus.cc:2229] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:28:17.516850 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 8786
I20260809 02:28:17.522521 9463 raft_consensus.cc:2258] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:28:17.524201 9463 ts_tablet_manager.cc:1905] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:28:17.525617 9461 tablet_replica.cc:330] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1: stopping tablet replica
I20260809 02:28:17.525959 9461 raft_consensus.cc:2229] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:28:17.526335 9461 raft_consensus.cc:2258] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:28:17.527536 9463 ts_tablet_manager.cc:1918] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:28:17.527643 9463 log.cc:1196] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/be1e5614871c466787704cdeac2d5c9e
I20260809 02:28:17.528007 9463 ts_tablet_manager.cc:1939] T be1e5614871c466787704cdeac2d5c9e P 37dab894fe5f4477af5eea7dcb6fea2a: Deleting consensus metadata
I20260809 02:28:17.527976 9461 ts_tablet_manager.cc:1905] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:28:17.529217 8706 catalog_manager.cc:4841] TS 37dab894fe5f4477af5eea7dcb6fea2a (127.21.214.130:42859): tablet be1e5614871c466787704cdeac2d5c9e (table test-table [id=f2184646ca6c4d29a716ba4f0371c0c1]) successfully deleted
I20260809 02:28:17.530857 9461 ts_tablet_manager.cc:1918] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:28:17.530966 9461 log.cc:1196] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/be1e5614871c466787704cdeac2d5c9e
I20260809 02:28:17.531340 9461 ts_tablet_manager.cc:1939] T be1e5614871c466787704cdeac2d5c9e P e9f691f6a8424bc48ec0d85ef529fcd1: Deleting consensus metadata
I20260809 02:28:17.532599 8709 catalog_manager.cc:4841] TS e9f691f6a8424bc48ec0d85ef529fcd1 (127.21.214.131:40663): tablet be1e5614871c466787704cdeac2d5c9e (table test-table [id=f2184646ca6c4d29a716ba4f0371c0c1]) successfully deleted
W20260809 02:28:17.540074 8708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:42385 (error 108)
I20260809 02:28:17.541728 9414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:17.541324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:42385 (local address 127.0.0.1:41212)
0809 02:28:17.541556 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:17.541636 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:42385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
W20260809 02:28:17.541919 8708 catalog_manager.cc:4584] TS 8a259ef236054ed2bc400b24d3a19d23 (127.21.214.129:42385): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet be1e5614871c466787704cdeac2d5c9e: Network error: Client connection negotiation failed: client connection to 127.21.214.129:42385: connect: Connection refused (error 111)
I20260809 02:28:17.542272 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 9014
I20260809 02:28:17.557392 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 9187
I20260809 02:28:17.573426 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 8678
I20260809 02:28:17.590101 22362 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 02:28:17.935125 22362 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 02:28:17.935302 22362 mini_ranger.cc:66] Stopping Ranger...
I20260809 02:28:18.290488 22362 mini_ranger.cc:68] Stopped Ranger
2026-08-09 02:28:18.290 UTC [7447] LOG: received smart shutdown request
2026-08-09 02:28:18.295 UTC [7447] LOG: background worker "logical replication launcher" (PID 7462) exited with exit code 1
2026-08-09 02:28:18.296 UTC [7454] LOG: shutting down
2026-08-09 02:28:18.487 UTC [7447] LOG: database system is shut down
2026-08-09T02:28:18Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52108 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:28:18 dist-test-slave-68xk krb5kdc[9485](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:28:18 dist-test-slave-68xk krb5kdc[9485](info): set up 2 sockets
Aug 09 02:28:18 dist-test-slave-68xk krb5kdc[9485](info): commencing operation
krb5kdc: starting...
W20260809 02:28:19.910384 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.269s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:28:19 dist-test-slave-68xk krb5kdc[9485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:28:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:28:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:28:20.046038 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:37503
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:40557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:37503,127.21.214.189:40063,127.21.214.188:32769
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:20.157820 9506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:20.158082 9506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:20.158121 9506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:20.162166 9506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:28:20.162228 9506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:20.162248 9506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:20.162266 9506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:28:20.162281 9506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:28:20.167585 9506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:40557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:37503,127.21.214.189:40063,127.21.214.188:32769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:37503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:20.168639 9506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:20.169684 9506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:20.178360 9515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:20.178362 9516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:20.178531 9506 server_base.cc:1034] running on GCE node
W20260809 02:28:20.178370 9518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:20.179334 9506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:20.180491 9506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:20.181707 9506 hybrid_clock.cc:648] HybridClock initialized: now 1786242500181676 us; error 49 us; skew 500 ppm
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242500, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:20.184821 9506 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:28:20.185678 9506 webserver.cc:460] Webserver started at http://127.21.214.190:41479/ using document root <none> and password file <none>
I20260809 02:28:20.186209 9506 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:20.186267 9506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:20.186497 9506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:28:20.188530 9506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "0d566503937944c3974727a9fd99229c"
format_stamp: "Formatted at 2026-08-09 02:28:20 on dist-test-slave-68xk"
server_key: "91653400ec1f6ed7cff9e2d779ba2bc3"
server_key_iv: "a7dad5e2da74b09bd3d9e2877052a18c"
server_key_version: "encryptionkey@0"
I20260809 02:28:20.189055 9506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "0d566503937944c3974727a9fd99229c"
format_stamp: "Formatted at 2026-08-09 02:28:20 on dist-test-slave-68xk"
server_key: "91653400ec1f6ed7cff9e2d779ba2bc3"
server_key_iv: "a7dad5e2da74b09bd3d9e2877052a18c"
server_key_version: "encryptionkey@0"
I20260809 02:28:20.192906 9506 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260809 02:28:20.195540 9526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:20.196868 9506 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:28:20.197013 9506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "0d566503937944c3974727a9fd99229c"
format_stamp: "Formatted at 2026-08-09 02:28:20 on dist-test-slave-68xk"
server_key: "91653400ec1f6ed7cff9e2d779ba2bc3"
server_key_iv: "a7dad5e2da74b09bd3d9e2877052a18c"
server_key_version: "encryptionkey@0"
I20260809 02:28:20.197193 9506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:20.226105 9506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:20.229744 9506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:20.229962 9506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:20.237592 9506 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:37503
I20260809 02:28:20.237937 9597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:37503 every 8 connection(s)
I20260809 02:28:20.238631 9506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:28:20.241641 9598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:20.242811 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 9506
I20260809 02:28:20.242951 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:28:20.243294 22362 external_mini_cluster.cc:1428] Setting key bb4f1e2ac63544fde5d3c8fd539001e9
I20260809 02:28:20.245872 9598 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.21.214.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.189@KRBTEST.COM" created.
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242500, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:20.262115 9602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.248432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39900 (local address 127.21.214.190:37503)
0809 02:28:20.248884 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.248906 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.249212 (+ 306us) server_negotiation.cc:407] Connection header received
0809 02:28:20.250294 (+ 1082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.250298 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.250554 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.250769 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.251694 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.252712 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.253841 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.254241 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.254562 (+ 321us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.257155 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.257161 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.257170 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.257191 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.258903 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.259409 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.259414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.259416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.259525 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.259839 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.259845 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.259847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.260287 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.260440 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.260804 (+ 364us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.261062 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":296,"thread_start_us":151,"threads_started":1}
I20260809 02:28:20.262125 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.248433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:37503 (local address 127.0.0.1:39900)
0809 02:28:20.249048 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.249094 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:20.249956 (+ 862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:20.250764 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:20.250769 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:20.251272 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:20.251528 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.251542 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.252864 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.252867 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.253712 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.253723 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.254435 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.254441 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.254710 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.255341 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:20.255359 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:20.256985 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:20.259034 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.259044 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.259054 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.259292 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.259622 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.259627 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.259629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.259745 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.260408 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:20.260414 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:20.260567 (+ 153us) client_negotiation.cc:769] Sending connection context
0809 02:28:20.260744 (+ 177us) client_negotiation.cc:240] Negotiation successful
0809 02:28:20.261117 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":229,"spinlock_wait_cycles":13696,"thread_start_us":170,"threads_started":1}
I20260809 02:28:20.265053 9598 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:28:20.265949 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.265612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40063 (local address 127.0.0.1:58394)
0809 02:28:20.265796 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.265874 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260809 02:28:20.266177 9527 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40063: connect: Connection refused (error 111)
I20260809 02:28:20.267210 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.266965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40063 (local address 127.0.0.1:58408)
0809 02:28:20.267068 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.267154 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 02:28:20.267380 9598 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.189:40063: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40063: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.189.keytab.
Entry for principal kudu/127.21.214.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.189.keytab.
I20260809 02:28:20.273941 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.189:40063
--webserver_interface=127.21.214.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.189.keytab
--principal=kudu/127.21.214.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:40557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:37503,127.21.214.189:40063,127.21.214.188:32769
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:28:20.316676 9598 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } attempt: 1
I20260809 02:28:20.317766 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.317317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40063 (local address 127.0.0.1:58412)
0809 02:28:20.317531 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.317625 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 02:28:20.318638 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.318374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40063 (local address 127.0.0.1:58420)
0809 02:28:20.318512 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.318571 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260809 02:28:20.318882 9598 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.189:40063: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40063: connect: Connection refused (error 111)
I20260809 02:28:20.387112 9598 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } attempt: 2
I20260809 02:28:20.388087 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.387738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40063 (local address 127.0.0.1:58422)
0809 02:28:20.387912 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.387986 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 02:28:20.388929 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.388697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40063 (local address 127.0.0.1:58430)
0809 02:28:20.388810 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.388865 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 02:28:20.389164 9598 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.189:40063: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40063: connect: Connection refused (error 111)
W20260809 02:28:20.390286 9606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:20.390585 9606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:20.390683 9606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:20.394769 9606 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:28:20.394825 9606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:20.394845 9606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:20.394862 9606 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:28:20.394877 9606 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:28:20.400520 9606 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:40557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:37503,127.21.214.189:40063,127.21.214.188:32769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.189.keytab
--principal=kudu/127.21.214.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.189:40063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.214.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:20.401674 9606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:20.402804 9606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:20.411216 9612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:20.411222 9613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:20.411233 9617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:20.411665 9606 server_base.cc:1034] running on GCE node
I20260809 02:28:20.412367 9606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:20.413563 9606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:20.414793 9606 hybrid_clock.cc:648] HybridClock initialized: now 1786242500414724 us; error 86 us; skew 500 ppm
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242500, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:20.418397 9606 init.cc:377] Logged in from keytab as kudu/127.21.214.189@KRBTEST.COM (short username kudu)
I20260809 02:28:20.419502 9606 webserver.cc:460] Webserver started at http://127.21.214.189:42967/ using document root <none> and password file <none>
I20260809 02:28:20.420043 9606 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:20.420102 9606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:20.420281 9606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:28:20.422394 9606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/data/instance:
uuid: "285379a81fb44af7884f6dd03e7fd42d"
format_stamp: "Formatted at 2026-08-09 02:28:20 on dist-test-slave-68xk"
server_key: "acf7c228eb4668e2340e72733d6e9cde"
server_key_iv: "b0dbf0f12de0c82f738dbcda0bd0bf1d"
server_key_version: "encryptionkey@0"
I20260809 02:28:20.423013 9606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/wal/instance:
uuid: "285379a81fb44af7884f6dd03e7fd42d"
format_stamp: "Formatted at 2026-08-09 02:28:20 on dist-test-slave-68xk"
server_key: "acf7c228eb4668e2340e72733d6e9cde"
server_key_iv: "b0dbf0f12de0c82f738dbcda0bd0bf1d"
server_key_version: "encryptionkey@0"
I20260809 02:28:20.427011 9606 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 02:28:20.429605 9625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:20.431033 9606 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:28:20.431185 9606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/wal
uuid: "285379a81fb44af7884f6dd03e7fd42d"
format_stamp: "Formatted at 2026-08-09 02:28:20 on dist-test-slave-68xk"
server_key: "acf7c228eb4668e2340e72733d6e9cde"
server_key_iv: "b0dbf0f12de0c82f738dbcda0bd0bf1d"
server_key_version: "encryptionkey@0"
I20260809 02:28:20.431298 9606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:20.442770 9606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:20.445979 9606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:20.446182 9606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:20.453716 9606 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.189:40063
I20260809 02:28:20.454001 9700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.189:40063 every 8 connection(s)
I20260809 02:28:20.454808 9606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/data/info.pb
I20260809 02:28:20.458158 9702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:20.461596 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 9606
I20260809 02:28:20.461766 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-1/wal/instance
I20260809 02:28:20.462069 22362 external_mini_cluster.cc:1428] Setting key 86dde802c16c42c81e2458591744b6f4
I20260809 02:28:20.462121 9702 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.21.214.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.188@KRBTEST.COM" created.
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242500, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.189@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:20.480057 9602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.464147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39910 (local address 127.21.214.190:37503)
0809 02:28:20.464343 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.464352 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.465260 (+ 908us) server_negotiation.cc:407] Connection header received
0809 02:28:20.466739 (+ 1479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.466742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.466810 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.466929 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.468302 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.468896 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.470151 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.470493 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.470630 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.475762 (+ 5132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.475765 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.475767 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.475792 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.477292 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.478019 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.478025 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.478027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.478170 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.478756 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.478759 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.478761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.478989 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.479119 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.479709 (+ 590us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.479856 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:28:20.480370 9598 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } attempt: 3
I20260809 02:28:20.481160 9705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.464481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:37503 (local address 127.0.0.1:39910)
0809 02:28:20.465052 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.465123 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:20.466481 (+ 1358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:20.467119 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:20.467127 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:20.467508 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:20.468138 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.468153 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.469044 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.469048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.470005 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.470015 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.470678 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.470682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.470868 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.471567 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:20.471594 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:20.475563 (+ 3969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:20.477429 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.477438 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.477460 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.477907 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.478317 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.478321 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.478324 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.478615 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.479117 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:20.479124 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:20.479416 (+ 292us) client_negotiation.cc:769] Sending connection context
0809 02:28:20.479626 (+ 210us) client_negotiation.cc:240] Negotiation successful
0809 02:28:20.480003 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":118,"threads_started":1}
I20260809 02:28:20.482932 9702 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242500, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for kudu/127.21.214.189@KRBTEST.COM
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242500, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.189@KRBTEST.COM for kudu/127.21.214.189@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.188.keytab.
Entry for principal kudu/127.21.214.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.188.keytab.
I20260809 02:28:20.493997 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.480848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40063 (local address 127.0.0.1:58440)
0809 02:28:20.481068 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.481084 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:20.481171 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:20.481957 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:20.481962 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:20.482148 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:20.482297 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.482306 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.484345 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.484349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.485350 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.485362 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.486139 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.486143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.486271 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.486828 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:20.486849 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:20.488724 (+ 1875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:20.491890 (+ 3166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.491892 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.491894 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.492085 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.492603 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.492606 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.492609 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.492715 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.493395 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:20.493398 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:20.493511 (+ 113us) client_negotiation.cc:769] Sending connection context
0809 02:28:20.493638 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 02:28:20.493804 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129}
I20260809 02:28:20.494076 9707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.480982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58440 (local address 127.21.214.189:40063)
0809 02:28:20.481473 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.481488 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.481514 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:28:20.481562 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.481571 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.481796 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.482486 (+ 690us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.482623 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.484208 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.485498 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.486001 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.486138 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.488877 (+ 2739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.488888 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.488904 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.488938 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.491794 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.492268 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.492275 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.492277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.492434 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.492862 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.492866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.492868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.493249 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.493434 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.493734 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.493890 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":362,"spinlock_wait_cycles":4352,"thread_start_us":177,"threads_started":1}
I20260809 02:28:20.494845 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.188:32769
--webserver_interface=127.21.214.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.188.keytab
--principal=kudu/127.21.214.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:40557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:37503,127.21.214.189:40063,127.21.214.188:32769
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:28:20.495239 9705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.483498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40063 (local address 127.0.0.1:58448)
0809 02:28:20.483591 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.483606 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:20.483697 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:20.484090 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:20.484093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:20.484307 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:20.484431 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.484438 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.485575 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.485578 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.486266 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.486276 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.486914 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.486920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.487076 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.487552 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:20.487572 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:20.488700 (+ 1128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:20.492226 (+ 3526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.492230 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.492234 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.492502 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.493131 (+ 629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.493134 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.493136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.493235 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.494777 (+ 1542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:20.494780 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:20.494860 (+ 80us) client_negotiation.cc:769] Sending connection context
0809 02:28:20.494953 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 02:28:20.495084 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":41}
I20260809 02:28:20.495718 9709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.483558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58448 (local address 127.21.214.189:40063)
0809 02:28:20.483895 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.483903 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.483914 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:28:20.483941 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.483943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.483974 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.484079 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.484556 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.485465 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.486361 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.486774 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.486906 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.489234 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.489238 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.489240 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.489260 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.491785 (+ 2525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.492862 (+ 1077us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.492866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.492868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.493013 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.494317 (+ 1304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.494321 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.494323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.494627 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.494743 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.495455 (+ 712us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.495570 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":269,"spinlock_wait_cycles":1280,"thread_start_us":123,"threads_started":1}
I20260809 02:28:20.496423 9598 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:28:20.497231 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.496893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:52938)
0809 02:28:20.497027 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.497150 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 02:28:20.497767 9702 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:28:20.498239 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.497729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:52940)
0809 02:28:20.498139 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.498186 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341}
W20260809 02:28:20.498466 9598 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:32769: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
I20260809 02:28:20.498677 9705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.498258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:52946)
0809 02:28:20.498491 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.498583 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
W20260809 02:28:20.498939 9626 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
I20260809 02:28:20.499979 9705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.499658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:52950)
0809 02:28:20.499819 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.499889 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260809 02:28:20.500219 9702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:32769: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
I20260809 02:28:20.529652 9598 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } attempt: 1
I20260809 02:28:20.530660 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.530296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:52966)
0809 02:28:20.530500 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.530576 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 02:28:20.531549 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.531324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:52976)
0809 02:28:20.531438 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.531487 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 02:28:20.531734 9598 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:32769: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
I20260809 02:28:20.549528 9702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } attempt: 1
I20260809 02:28:20.550562 9705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.550195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:52988)
0809 02:28:20.550362 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.550467 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 02:28:20.551467 9705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.551121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:53000)
0809 02:28:20.551325 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.551391 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
W20260809 02:28:20.551782 9702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:32769: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
I20260809 02:28:20.606925 9598 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } attempt: 2
I20260809 02:28:20.607995 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.607607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:53012)
0809 02:28:20.607802 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.607883 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260809 02:28:20.608865 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.608649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:53022)
0809 02:28:20.608760 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.608809 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 02:28:20.609046 9598 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:32769: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
W20260809 02:28:20.616076 9710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:20.616307 9710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:20.616389 9710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 02:28:20.619975 9702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } attempt: 2
W20260809 02:28:20.620610 9710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:28:20.620682 9710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:20.620712 9710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:20.620738 9710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:28:20.620766 9710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:28:20.620800 9705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.620470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:53032)
0809 02:28:20.620626 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.620703 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 02:28:20.621496 9705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.621282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:53048)
0809 02:28:20.621388 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.621436 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 02:28:20.621660 9702 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:32769: Network error: Client connection negotiation failed: client connection to 127.21.214.188:32769: connect: Connection refused (error 111)
I20260809 02:28:20.626296 9710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:40557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:37503,127.21.214.189:40063,127.21.214.188:32769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.188.keytab
--principal=kudu/127.21.214.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.188:32769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.214.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:20.627395 9710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:20.628449 9710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:20.637108 9719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:20.637118 9718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:20.637389 9710 server_base.cc:1034] running on GCE node
W20260809 02:28:20.637188 9721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:20.638032 9710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:20.639187 9710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:20.640352 9710 hybrid_clock.cc:648] HybridClock initialized: now 1786242500640339 us; error 24 us; skew 500 ppm
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242500, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:20.643332 9710 init.cc:377] Logged in from keytab as kudu/127.21.214.188@KRBTEST.COM (short username kudu)
I20260809 02:28:20.644244 9710 webserver.cc:460] Webserver started at http://127.21.214.188:36513/ using document root <none> and password file <none>
I20260809 02:28:20.644802 9710 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:20.644863 9710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:20.645107 9710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:28:20.647238 9710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/data/instance:
uuid: "a139332b8951469b8bbc77c7bbb3a6ad"
format_stamp: "Formatted at 2026-08-09 02:28:20 on dist-test-slave-68xk"
server_key: "4309c337870ac4f590ccd3e290dfbecc"
server_key_iv: "942ed28913c2addbf3e845720c988f06"
server_key_version: "encryptionkey@0"
I20260809 02:28:20.647823 9710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/wal/instance:
uuid: "a139332b8951469b8bbc77c7bbb3a6ad"
format_stamp: "Formatted at 2026-08-09 02:28:20 on dist-test-slave-68xk"
server_key: "4309c337870ac4f590ccd3e290dfbecc"
server_key_iv: "942ed28913c2addbf3e845720c988f06"
server_key_version: "encryptionkey@0"
I20260809 02:28:20.651482 9710 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:28:20.653863 9729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:20.655141 9710 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:28:20.655303 9710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/wal
uuid: "a139332b8951469b8bbc77c7bbb3a6ad"
format_stamp: "Formatted at 2026-08-09 02:28:20 on dist-test-slave-68xk"
server_key: "4309c337870ac4f590ccd3e290dfbecc"
server_key_iv: "942ed28913c2addbf3e845720c988f06"
server_key_version: "encryptionkey@0"
I20260809 02:28:20.655417 9710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:20.671096 9710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:20.674518 9710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:20.674732 9710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:20.681979 9710 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.188:32769
I20260809 02:28:20.682312 9805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.188:32769 every 8 connection(s)
I20260809 02:28:20.683010 9710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/data/info.pb
I20260809 02:28:20.683450 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 9710
I20260809 02:28:20.683596 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786242328272206-22362-0/minicluster-data/master-2/wal/instance
I20260809 02:28:20.683890 22362 external_mini_cluster.cc:1428] Setting key 6923e91dad20eedfbae6f9c8baf594e6
I20260809 02:28:20.686184 9806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:20.689996 9806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.188@KRBTEST.COM
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242500, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.188@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:20.699134 9811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.685316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53054 (local address 127.21.214.188:32769)
0809 02:28:20.685768 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.685783 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.685819 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:28:20.686671 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.686712 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.687070 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.687410 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.688290 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.689301 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.690170 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.690761 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.690942 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.693748 (+ 2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.693753 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.693762 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.693788 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.695881 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.696363 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.696368 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.696372 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.696481 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.696774 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.696778 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.696780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.697201 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.697402 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.697712 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.698236 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":147,"threads_started":1}
I20260809 02:28:20.701769 9602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.691797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39926 (local address 127.21.214.190:37503)
0809 02:28:20.691930 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.691935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.692256 (+ 321us) server_negotiation.cc:407] Connection header received
0809 02:28:20.692423 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.692426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.692481 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.692569 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.693256 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.693747 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.694922 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.695280 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.695398 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.697534 (+ 2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.697540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.697543 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.697572 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.699020 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.700283 (+ 1263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.700289 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.700292 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.700374 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.700664 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.700668 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.700670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.700899 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.701037 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.701496 (+ 459us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.701606 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:28:20.701810 9812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.691744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:37503 (local address 127.0.0.1:39926)
0809 02:28:20.692119 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.692171 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:20.692317 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:20.692622 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:20.692627 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:20.692982 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:20.693110 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.693115 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.693872 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.693877 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.694786 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.694801 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.695412 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.695415 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.695502 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.695989 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:20.696000 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:20.697411 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:20.699137 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.699148 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.699163 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.700175 (+ 1012us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.700471 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.700476 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.700477 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.700567 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.701099 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:20.701107 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:20.701241 (+ 134us) client_negotiation.cc:769] Sending connection context
0809 02:28:20.701429 (+ 188us) client_negotiation.cc:240] Negotiation successful
0809 02:28:20.701626 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":155,"threads_started":1}
I20260809 02:28:20.702883 9806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242500, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.188@KRBTEST.COM for kudu/127.21.214.189@KRBTEST.COM
I20260809 02:28:20.708238 9598 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } attempt: 3
I20260809 02:28:20.711423 9813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.701369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39938 (local address 127.21.214.190:37503)
0809 02:28:20.701692 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.701703 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.701714 (+ 11us) server_negotiation.cc:407] Connection header received
0809 02:28:20.701741 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.701743 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.701774 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.702618 (+ 844us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.702722 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.703813 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.704578 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.704820 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.704931 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.707357 (+ 2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.707361 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.707362 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.707383 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.709230 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.710001 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.710004 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.710006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.710096 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.710456 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.710459 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.710462 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.710753 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.710961 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.711099 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.711246 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":264,"thread_start_us":102,"threads_started":1}
I20260809 02:28:20.712065 9812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.703365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40063 (local address 127.0.0.1:58450)
0809 02:28:20.703474 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.703489 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:20.703561 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:20.703855 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:20.703858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:20.704022 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:20.704110 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.704116 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.704863 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.704868 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.705383 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.705390 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.705893 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.705896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.705996 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.706977 (+ 981us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:20.706994 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:20.708180 (+ 1186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:20.710389 (+ 2209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.710393 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.710397 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.710662 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.710972 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.710978 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.710983 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.711076 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.711570 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:20.711575 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:20.711671 (+ 96us) client_negotiation.cc:769] Sending connection context
0809 02:28:20.711787 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 02:28:20.711921 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 02:28:20.712172 9709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.703504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58450 (local address 127.21.214.189:40063)
0809 02:28:20.703643 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.703649 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.703662 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:28:20.703709 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.703711 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.703753 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.703841 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.704234 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.704751 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.705529 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.705777 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.705894 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.708330 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.708336 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.708341 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.708370 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.710261 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.710767 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.710770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.710773 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.710863 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.711186 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.711192 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.711197 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.711398 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.711478 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.711873 (+ 395us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.711997 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:28:20.712841 9702 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } attempt: 3
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242500, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for kudu/127.21.214.188@KRBTEST.COM
I20260809 02:28:20.713593 9806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:28:20.717482 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.708707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:53070)
0809 02:28:20.708826 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.708841 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:20.708909 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:20.709432 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:20.709435 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:20.709587 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:20.709660 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.709665 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.710553 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.710560 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.711396 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.711407 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.711938 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.711942 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.712027 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.712479 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:20.712496 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:20.713974 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:20.715895 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.715899 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.715901 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.716175 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.716478 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.716481 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.716482 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.716563 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.716981 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:20.716984 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:20.717074 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 02:28:20.717190 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 02:28:20.717316 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":29}
I20260809 02:28:20.718328 9811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.709048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53070 (local address 127.21.214.188:32769)
0809 02:28:20.709196 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.709202 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.709217 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:28:20.709257 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.709262 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.709312 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.709416 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.709773 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.710458 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.711534 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.711801 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.712249 (+ 448us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.714166 (+ 1917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.714172 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.714179 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.714207 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.715774 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.716292 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.716295 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.716297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.716377 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.716667 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.716670 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.716671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.716851 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.716936 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.717771 (+ 835us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.717900 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242500, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.188@KRBTEST.COM for kudu/127.21.214.188@KRBTEST.COM
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.189@KRBTEST.COM
Aug 09 02:28:20 dist-test-slave-68xk krb5kdc[9485](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242500, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.189@KRBTEST.COM for kudu/127.21.214.188@KRBTEST.COM
I20260809 02:28:20.722476 9598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c: Bootstrap starting.
I20260809 02:28:20.725188 9812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.714039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:53090)
0809 02:28:20.714529 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.714543 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:20.714620 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:20.714889 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:20.714894 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:20.715092 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:20.715209 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.715218 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.716644 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.716646 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.717399 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.717408 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.718279 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.718282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.718358 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.719113 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:20.719128 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:20.721632 (+ 2504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:20.723741 (+ 2109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.723744 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.723745 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.723992 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.724274 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.724278 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.724283 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.724359 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.724748 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:20.724750 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:20.724823 (+ 73us) client_negotiation.cc:769] Sending connection context
0809 02:28:20.724915 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 02:28:20.725050 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416}
I20260809 02:28:20.725457 9709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.713681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58462 (local address 127.21.214.189:40063)
0809 02:28:20.713785 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.713788 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.713966 (+ 178us) server_negotiation.cc:407] Connection header received
0809 02:28:20.714147 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.714150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.714197 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.714250 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.715198 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.716191 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.717262 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.717600 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.717689 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.721249 (+ 3560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.721253 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.721256 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.721285 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.723331 (+ 2046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.723852 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.723857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.723860 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.723957 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.724333 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.724337 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.724339 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.724568 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.724761 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.725172 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.725298 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":118,"server-negotiator.queue_time_us":41}
I20260809 02:28:20.725792 9815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.714253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53090 (local address 127.21.214.188:32769)
0809 02:28:20.714605 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.714615 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.714630 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:28:20.714705 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.714710 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.714756 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.714853 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.715322 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.716534 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.717503 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.718147 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.718279 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.721767 (+ 3488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.721770 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.721772 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.721794 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.723630 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.724095 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.724098 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.724100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.724181 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.724444 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.724447 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.724448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.724631 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.724717 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.725469 (+ 752us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.725577 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":108,"threads_started":1}
I20260809 02:28:20.725802 9598 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:20.726783 9598 log.cc:824] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:20.728570 9705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.713206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:32769 (local address 127.0.0.1:53076)
0809 02:28:20.713441 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:20.713454 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:20.713523 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:20.714296 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:20.714301 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:20.715186 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:20.715324 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.715330 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.716936 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.716940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.717741 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:20.717752 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.718870 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.718876 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:20.718991 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.719450 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:20.719465 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:20.721826 (+ 2361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:20.724826 (+ 3000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.724831 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.724834 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.725101 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.726808 (+ 1707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:20.726813 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:20.726814 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:20.726917 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:20.728128 (+ 1211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:20.728131 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:20.728223 (+ 92us) client_negotiation.cc:769] Sending connection context
0809 02:28:20.728308 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 02:28:20.728448 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":20}
I20260809 02:28:20.728735 9806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad: Bootstrap starting.
I20260809 02:28:20.729065 9598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c: No bootstrap required, opened a new log
I20260809 02:28:20.729583 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:28:20.731431 9806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:20.731684 9814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.713282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53076 (local address 127.21.214.188:32769)
0809 02:28:20.714050 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.714061 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.714074 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:28:20.714109 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.714111 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.714153 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.715253 (+ 1100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.716025 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.716808 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.717941 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.718333 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.718456 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.721964 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.721969 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.721973 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.722000 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.724708 (+ 2708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.725220 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.725222 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.725224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.725800 (+ 576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.727778 (+ 1978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.727784 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.727789 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.728006 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.729041 (+ 1035us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.729120 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.731495 (+ 2375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":124,"threads_started":1}
I20260809 02:28:20.733279 9598 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } }
I20260809 02:28:20.733513 9598 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:20.733596 9598 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d566503937944c3974727a9fd99229c, State: Initialized, Role: FOLLOWER
I20260809 02:28:20.734110 9598 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } }
I20260809 02:28:20.734499 9702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d: Bootstrap starting.
I20260809 02:28:20.735525 9598 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:28:20.737072 9702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d: Neither blocks nor log segments found. Creating new log.
W20260809 02:28:20.741647 9843 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:28:20.741720 9843 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:28:20.742563 9828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } } }
I20260809 02:28:20.742686 9828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:28:20.743009 9813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.732900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39942 (local address 127.21.214.190:37503)
0809 02:28:20.732995 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.732999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.733011 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:28:20.733045 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.733048 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.733103 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.733183 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.734200 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.735033 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.736196 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.736549 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.736620 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.738821 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.738827 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.738829 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.738859 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.741057 (+ 2198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.741552 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.741555 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.741557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.741645 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.741960 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.741963 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.741965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.742168 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.742293 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.742714 (+ 421us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.742841 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 02:28:20.740432 9506 master_runner.cc:186] Error getting master registration for 127.21.214.189:40063: OK, instance_id { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" instance_seqno: 1786242500451694 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:28:20.744158 9506 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:28:20.744516 9709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.733015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58470 (local address 127.21.214.189:40063)
0809 02:28:20.733112 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.733116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.733128 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:28:20.733177 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.733179 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.733215 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.733282 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.734493 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.735211 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.736369 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.736683 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.736757 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.738912 (+ 2155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.738916 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.738919 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.738940 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.740648 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.742653 (+ 2005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.742657 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.742658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.742744 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.743394 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.743398 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.743399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.743587 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.743674 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.744251 (+ 577us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.744368 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:28:20.744951 9806 log.cc:824] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:20.745487 9702 log.cc:824] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:20.747905 9806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad: No bootstrap required, opened a new log
I20260809 02:28:20.748018 9702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d: No bootstrap required, opened a new log
I20260809 02:28:20.752225 9702 raft_consensus.cc:348] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } }
I20260809 02:28:20.752465 9702 raft_consensus.cc:374] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:20.752522 9702 raft_consensus.cc:729] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 285379a81fb44af7884f6dd03e7fd42d, State: Initialized, Role: FOLLOWER
I20260809 02:28:20.752780 9814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:20.732775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53098 (local address 127.21.214.188:32769)
0809 02:28:20.732873 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:20.732878 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:20.737121 (+ 4243us) server_negotiation.cc:407] Connection header received
0809 02:28:20.737719 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:20.737724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:20.737780 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:20.737835 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:20.741427 (+ 3592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.742180 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.746153 (+ 3973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:20.746500 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:20.746602 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:20.748431 (+ 1829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:20.748435 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:20.748437 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:20.748462 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:20.750197 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.750749 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.750753 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.750754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.750842 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:20.751136 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:20.751142 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:20.751145 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:20.751349 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:20.752010 (+ 661us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:20.752442 (+ 432us) server_negotiation.cc:299] Negotiation successful
0809 02:28:20.752571 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 02:28:20.752655 9806 raft_consensus.cc:348] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } }
I20260809 02:28:20.753057 9702 consensus_queue.cc:260] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } }
I20260809 02:28:20.753206 9806 raft_consensus.cc:374] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:20.753269 9806 raft_consensus.cc:729] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a139332b8951469b8bbc77c7bbb3a6ad, State: Initialized, Role: FOLLOWER
I20260809 02:28:20.753710 9806 consensus_queue.cc:260] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } }
I20260809 02:28:20.754588 9702 sys_catalog.cc:564] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:28:20.755028 9806 sys_catalog.cc:564] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [sys.catalog]: configured and running, proceeding with master startup.
W20260809 02:28:20.760903 9871 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:28:20.760986 9871 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:28:20.761178 9850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } } }
I20260809 02:28:20.761308 9850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:28:20.764775 9606 master_runner.cc:263] No leader master found from master 285379a81fb44af7884f6dd03e7fd42d
I20260809 02:28:20.764844 9606 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:28:20.766564 9851 sys_catalog.cc:455] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } } }
I20260809 02:28:20.766695 9851 sys_catalog.cc:458] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [sys.catalog]: This master's current role is: FOLLOWER
W20260809 02:28:20.767199 9880 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:28:20.767275 9880 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:28:20.767294 9710 master_runner.cc:263] No leader master found from master a139332b8951469b8bbc77c7bbb3a6ad
I20260809 02:28:20.767340 9710 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:28:20.880374 9828 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:28:20.880592 9828 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } }
I20260809 02:28:20.881628 9828 leader_election.cc:288] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 285379a81fb44af7884f6dd03e7fd42d (127.21.214.189:40063), a139332b8951469b8bbc77c7bbb3a6ad (127.21.214.188:32769)
I20260809 02:28:20.882354 9662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0d566503937944c3974727a9fd99229c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "285379a81fb44af7884f6dd03e7fd42d" is_pre_election: true
I20260809 02:28:20.882699 9662 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d566503937944c3974727a9fd99229c in term 0.
I20260809 02:28:20.883167 9527 leader_election.cc:302] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d566503937944c3974727a9fd99229c, 285379a81fb44af7884f6dd03e7fd42d; no voters:
I20260809 02:28:20.883481 9828 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:28:20.883575 9828 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:28:20.883630 9828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:20.885005 9828 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } }
I20260809 02:28:20.885396 9828 leader_election.cc:288] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [CANDIDATE]: Term 1 election: Requested vote from peers 285379a81fb44af7884f6dd03e7fd42d (127.21.214.189:40063), a139332b8951469b8bbc77c7bbb3a6ad (127.21.214.188:32769)
I20260809 02:28:20.885877 9662 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0d566503937944c3974727a9fd99229c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "285379a81fb44af7884f6dd03e7fd42d"
I20260809 02:28:20.886009 9662 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:20.887382 9662 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d566503937944c3974727a9fd99229c in term 1.
I20260809 02:28:20.887708 9527 leader_election.cc:302] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d566503937944c3974727a9fd99229c, 285379a81fb44af7884f6dd03e7fd42d; no voters:
I20260809 02:28:20.888244 9768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0d566503937944c3974727a9fd99229c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" is_pre_election: true
I20260809 02:28:20.888554 9768 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d566503937944c3974727a9fd99229c in term 0.
I20260809 02:28:20.889039 9768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0d566503937944c3974727a9fd99229c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a139332b8951469b8bbc77c7bbb3a6ad"
I20260809 02:28:20.889175 9768 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:20.890488 9768 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d566503937944c3974727a9fd99229c in term 1.
I20260809 02:28:20.890944 9828 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:28:20.891212 9828 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [term 1 LEADER]: Becoming Leader. State: Replica: 0d566503937944c3974727a9fd99229c, State: Running, Role: LEADER
I20260809 02:28:20.891554 9828 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } }
I20260809 02:28:20.893585 9828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d566503937944c3974727a9fd99229c. Latest consensus state: current_term: 1 leader_uuid: "0d566503937944c3974727a9fd99229c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } } }
I20260809 02:28:20.893705 9828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:20.894481 9885 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:28:20.895613 9885 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:28:20.903697 9768 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [term 1 FOLLOWER]: Refusing update from remote peer 0d566503937944c3974727a9fd99229c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:28:20.904392 9882 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:28:20.909212 9851 sys_catalog.cc:455] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d566503937944c3974727a9fd99229c. Latest consensus state: current_term: 1 leader_uuid: "0d566503937944c3974727a9fd99229c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } } }
I20260809 02:28:20.909358 9851 sys_catalog.cc:458] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:28:20.909644 9662 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [term 1 FOLLOWER]: Refusing update from remote peer 0d566503937944c3974727a9fd99229c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:28:20.910243 9882 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [LEADER]: Connected to new peer: Peer: permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:28:20.914497 9850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d566503937944c3974727a9fd99229c. Latest consensus state: current_term: 1 leader_uuid: "0d566503937944c3974727a9fd99229c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } } }
I20260809 02:28:20.914687 9850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [sys.catalog]: This master's current role is: FOLLOWER
W20260809 02:28:20.926121 9736 tablet.cc:2369] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:28:20.927672 9882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0d566503937944c3974727a9fd99229c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } } }
I20260809 02:28:20.927822 9882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:20.929327 9851 sys_catalog.cc:455] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0d566503937944c3974727a9fd99229c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } } }
I20260809 02:28:20.929457 9851 sys_catalog.cc:458] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:28:20.930240 9886 mvcc.cc:205] Tried to move back new op lower bound from 7316449283693342720 to 7316449283655868416. Current Snapshot: MvccSnapshot[applied={T|T < 7316449283693342720}]
I20260809 02:28:20.932907 9828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0d566503937944c3974727a9fd99229c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } } }
I20260809 02:28:20.933034 9828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:20.934473 9850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0d566503937944c3974727a9fd99229c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d566503937944c3974727a9fd99229c" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 37503 } } peers { permanent_uuid: "285379a81fb44af7884f6dd03e7fd42d" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40063 } } peers { permanent_uuid: "a139332b8951469b8bbc77c7bbb3a6ad" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 32769 } } }
I20260809 02:28:20.934607 9850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:28:20.937819 9892 mvcc.cc:205] Tried to move back new op lower bound from 7316449283693342720 to 7316449283655868416. Current Snapshot: MvccSnapshot[applied={T|T < 7316449283693342720}]
I20260809 02:28:20.941913 9885 catalog_manager.cc:1347] Generated new cluster ID: 8c73c863b8e14a3f9dac7e3962dd2919
I20260809 02:28:20.941987 9885 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:28:20.967773 9885 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:28:20.968816 9885 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:28:20.975308 9885 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d566503937944c3974727a9fd99229c: Generated new TSK 0
I20260809 02:28:20.976272 9885 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:28:21.762435 9871 catalog_manager.cc:1259] Loaded cluster ID: 8c73c863b8e14a3f9dac7e3962dd2919
I20260809 02:28:21.762559 9871 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d: loading cluster ID for follower catalog manager: success
I20260809 02:28:21.764411 9871 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d: acquiring CA information for follower catalog manager: success
I20260809 02:28:21.765695 9871 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 285379a81fb44af7884f6dd03e7fd42d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:28:21.768338 9880 catalog_manager.cc:1259] Loaded cluster ID: 8c73c863b8e14a3f9dac7e3962dd2919
I20260809 02:28:21.768400 9880 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad: loading cluster ID for follower catalog manager: success
I20260809 02:28:21.770006 9880 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad: acquiring CA information for follower catalog manager: success
I20260809 02:28:21.771116 9880 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a139332b8951469b8bbc77c7bbb3a6ad: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:28:22.058261 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 9506
I20260809 02:28:22.071481 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 9606
I20260809 02:28:22.083668 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 9710
2026-08-09T02:28:22Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3468 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:28:22 dist-test-slave-68xk krb5kdc[9904](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:28:22 dist-test-slave-68xk krb5kdc[9904](info): set up 2 sockets
Aug 09 02:28:22 dist-test-slave-68xk krb5kdc[9904](info): commencing operation
krb5kdc: starting...
W20260809 02:28:23.362284 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:28:23 dist-test-slave-68xk krb5kdc[9904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:28:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:28:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:28:23.498049 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:44281
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:36041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:44281
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:23.612041 9926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:23.612351 9926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:23.612435 9926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:23.616379 9926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:28:23.616461 9926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:23.616501 9926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:23.616557 9926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:28:23.616598 9926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:28:23.621762 9926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:36041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:44281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:44281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:23.622848 9926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:23.623878 9926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:23.632730 9934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:23.632730 9936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:23.632870 9926 server_base.cc:1034] running on GCE node
W20260809 02:28:23.633055 9933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:23.633684 9926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:23.634840 9926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:23.636009 9926 hybrid_clock.cc:648] HybridClock initialized: now 1786242503635992 us; error 33 us; skew 500 ppm
Aug 09 02:28:23 dist-test-slave-68xk krb5kdc[9904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242503, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:23.638877 9926 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:28:23.639757 9926 webserver.cc:460] Webserver started at http://127.21.214.190:34077/ using document root <none> and password file <none>
I20260809 02:28:23.640290 9926 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:23.640353 9926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:23.640519 9926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:28:23.642581 9926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "22536a6cd5704aa09d0b75415917ef8d"
format_stamp: "Formatted at 2026-08-09 02:28:23 on dist-test-slave-68xk"
server_key: "46dca8733dbed3fa7d565b515f0842a2"
server_key_iv: "0ce6916fa55cd19820acac46cb77e283"
server_key_version: "encryptionkey@0"
I20260809 02:28:23.643102 9926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "22536a6cd5704aa09d0b75415917ef8d"
format_stamp: "Formatted at 2026-08-09 02:28:23 on dist-test-slave-68xk"
server_key: "46dca8733dbed3fa7d565b515f0842a2"
server_key_iv: "0ce6916fa55cd19820acac46cb77e283"
server_key_version: "encryptionkey@0"
I20260809 02:28:23.646867 9926 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260809 02:28:23.649215 9945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:23.650540 9926 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:28:23.650640 9926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "22536a6cd5704aa09d0b75415917ef8d"
format_stamp: "Formatted at 2026-08-09 02:28:23 on dist-test-slave-68xk"
server_key: "46dca8733dbed3fa7d565b515f0842a2"
server_key_iv: "0ce6916fa55cd19820acac46cb77e283"
server_key_version: "encryptionkey@0"
I20260809 02:28:23.650723 9926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:23.667959 9926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:23.671445 9926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:23.671623 9926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:23.679629 9926 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:44281
I20260809 02:28:23.679668 10012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:44281 every 8 connection(s)
I20260809 02:28:23.680636 9926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:28:23.683488 10013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:23.685577 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 9926
I20260809 02:28:23.685719 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:28:23.686017 22362 external_mini_cluster.cc:1428] Setting key 6cf682591794f9d0577c717b75226888
I20260809 02:28:23.690701 10013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d: Bootstrap starting.
I20260809 02:28:23.692902 10013 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:23.693657 10013 log.cc:824] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:23.695755 10013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d: No bootstrap required, opened a new log
Aug 09 02:28:23 dist-test-slave-68xk krb5kdc[9904](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:23.699658 10013 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22536a6cd5704aa09d0b75415917ef8d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44281 } }
I20260809 02:28:23.699942 10013 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:23.700026 10013 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22536a6cd5704aa09d0b75415917ef8d, State: Initialized, Role: FOLLOWER
I20260809 02:28:23.700551 10013 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22536a6cd5704aa09d0b75415917ef8d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44281 } }
I20260809 02:28:23.700721 10013 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:28:23.700820 10013 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:28:23.700929 10013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:23.701833 10013 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22536a6cd5704aa09d0b75415917ef8d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44281 } }
I20260809 02:28:23.702232 10013 leader_election.cc:302] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22536a6cd5704aa09d0b75415917ef8d; no voters:
I20260809 02:28:23.702603 10013 leader_election.cc:288] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:28:23.702714 10018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:28:23.702948 10018 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [term 1 LEADER]: Becoming Leader. State: Replica: 22536a6cd5704aa09d0b75415917ef8d, State: Running, Role: LEADER
I20260809 02:28:23.703269 10018 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22536a6cd5704aa09d0b75415917ef8d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44281 } }
I20260809 02:28:23.704003 10013 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:28:23.704500 10020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22536a6cd5704aa09d0b75415917ef8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22536a6cd5704aa09d0b75415917ef8d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44281 } } }
I20260809 02:28:23.704630 10020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:23.704636 10016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:23.687448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47240 (local address 127.21.214.190:44281)
0809 02:28:23.687882 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:23.687897 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:23.687932 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:28:23.688563 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:23.688579 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:23.688899 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:23.689237 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:23.690242 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:23.691334 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:23.692200 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:23.692680 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:23.692859 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:23.699091 (+ 6232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:23.699096 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:23.699108 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:23.699136 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:23.701146 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:23.701593 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:23.701599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:23.701604 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:23.701734 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:23.702047 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:23.702051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:23.702052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:23.702651 (+ 599us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:23.702943 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:23.703292 (+ 349us) server_negotiation.cc:299] Negotiation successful
0809 02:28:23.703602 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":125,"threads_started":1}
I20260809 02:28:23.704882 10020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22536a6cd5704aa09d0b75415917ef8d. Latest consensus state: current_term: 1 leader_uuid: "22536a6cd5704aa09d0b75415917ef8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22536a6cd5704aa09d0b75415917ef8d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44281 } } }
I20260809 02:28:23.704959 10020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:23.705564 10022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:28:23.708236 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:28:23.709236 10022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:28:23.714879 10022 catalog_manager.cc:1347] Generated new cluster ID: db1e437f3f174b61b2615885c266af91
I20260809 02:28:23.714942 10022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:28:23.726361 10022 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:28:23.727262 10022 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:28:23.732721 10022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22536a6cd5704aa09d0b75415917ef8d: Generated new TSK 0
I20260809 02:28:23.733517 10022 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:28:23.764348 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 9926
2026-08-09T02:28:23Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1680 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:28:23 dist-test-slave-68xk krb5kdc[10048](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:28:23 dist-test-slave-68xk krb5kdc[10048](info): set up 2 sockets
Aug 09 02:28:23 dist-test-slave-68xk krb5kdc[10048](info): commencing operation
krb5kdc: starting...
W20260809 02:28:24.991014 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.201s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:28:25 dist-test-slave-68xk krb5kdc[10048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:28:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:28:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:28:25.125211 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:45647
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:43643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:45647
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:25.253661 10068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:25.254034 10068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:25.254104 10068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:25.258244 10068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:28:25.258296 10068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:25.258316 10068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:25.258332 10068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:28:25.258390 10068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:28:25.263588 10068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:45647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:45647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:25.264605 10068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:25.265702 10068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:25.274168 10079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:25.274226 10076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:25.274238 10075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:25.274396 10068 server_base.cc:1034] running on GCE node
I20260809 02:28:25.275166 10068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:25.276240 10068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:25.277436 10068 hybrid_clock.cc:648] HybridClock initialized: now 1786242505277408 us; error 39 us; skew 500 ppm
Aug 09 02:28:25 dist-test-slave-68xk krb5kdc[10048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242505, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:25.280431 10068 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:28:25.281451 10068 webserver.cc:460] Webserver started at http://127.21.214.190:46489/ using document root <none> and password file <none>
I20260809 02:28:25.282068 10068 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:25.282136 10068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:25.282378 10068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:28:25.284677 10068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "73fe5b6cd6834949855d08535df89ccc"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "aa10dabaeef311eb69e95610d6e64869"
server_key_iv: "5c125ad406d0033e1f7888574b3ece10"
server_key_version: "encryptionkey@0"
I20260809 02:28:25.285327 10068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "73fe5b6cd6834949855d08535df89ccc"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "aa10dabaeef311eb69e95610d6e64869"
server_key_iv: "5c125ad406d0033e1f7888574b3ece10"
server_key_version: "encryptionkey@0"
I20260809 02:28:25.289542 10068 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260809 02:28:25.292243 10088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:25.293603 10068 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:28:25.293748 10068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "73fe5b6cd6834949855d08535df89ccc"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "aa10dabaeef311eb69e95610d6e64869"
server_key_iv: "5c125ad406d0033e1f7888574b3ece10"
server_key_version: "encryptionkey@0"
I20260809 02:28:25.293859 10068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:25.333220 10068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:25.336391 10068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:25.336606 10068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:25.344192 10068 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:45647
I20260809 02:28:25.344543 10158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:45647 every 8 connection(s)
I20260809 02:28:25.345222 10068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:28:25.348033 10159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:25.352686 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 10068
I20260809 02:28:25.352830 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:28:25.353138 22362 external_mini_cluster.cc:1428] Setting key 803af090c4d93bc143c37c3afccc6243
I20260809 02:28:25.353600 10159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Bootstrap starting.
I20260809 02:28:25.356107 10159 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:25.357007 10159 log.cc:824] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:25.359125 10159 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: No bootstrap required, opened a new log
Aug 09 02:28:25 dist-test-slave-68xk krb5kdc[10048](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242505, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:25.363564 10159 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } }
I20260809 02:28:25.363827 10159 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:25.363893 10159 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73fe5b6cd6834949855d08535df89ccc, State: Initialized, Role: FOLLOWER
I20260809 02:28:25.364315 10159 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } }
I20260809 02:28:25.364502 10159 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:28:25.364569 10159 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:28:25.364691 10159 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:25.365572 10159 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } }
I20260809 02:28:25.365898 10159 leader_election.cc:302] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73fe5b6cd6834949855d08535df89ccc; no voters:
I20260809 02:28:25.366221 10159 leader_election.cc:288] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:28:25.366297 10167 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:28:25.366504 10167 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 1 LEADER]: Becoming Leader. State: Replica: 73fe5b6cd6834949855d08535df89ccc, State: Running, Role: LEADER
I20260809 02:28:25.366793 10167 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } }
I20260809 02:28:25.367513 10159 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:28:25.367933 10167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73fe5b6cd6834949855d08535df89ccc. Latest consensus state: current_term: 1 leader_uuid: "73fe5b6cd6834949855d08535df89ccc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } } }
I20260809 02:28:25.368047 10167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:25.368348 10172 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:28:25.368551 10168 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73fe5b6cd6834949855d08535df89ccc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } } }
I20260809 02:28:25.368676 10168 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:25.369316 10165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:25.354720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56448 (local address 127.21.214.190:45647)
0809 02:28:25.355168 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:25.355190 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:25.355236 (+ 46us) server_negotiation.cc:407] Connection header received
0809 02:28:25.355923 (+ 687us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:25.355941 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:25.356347 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:25.356643 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:25.357627 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:25.358757 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:25.359908 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:25.360370 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:25.360507 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:25.363436 (+ 2929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:25.363441 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:25.363455 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:25.363482 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:25.365510 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:25.366064 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:25.366071 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:25.366077 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:25.366246 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:25.366673 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:25.366677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:25.366678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:25.367244 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:25.367456 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:25.367851 (+ 395us) server_negotiation.cc:299] Negotiation successful
0809 02:28:25.368356 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":155,"threads_started":1}
I20260809 02:28:25.371229 10172 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:28:25.377537 10172 catalog_manager.cc:1347] Generated new cluster ID: 6abc73f7b94f47ec84cec921656d6104
I20260809 02:28:25.377625 10172 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:28:25.404944 10172 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:28:25.406349 10172 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:28:25.428062 10172 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Generated new TSK 0
I20260809 02:28:25.428884 10172 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:28:25.463544 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45647
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:43643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:25.578835 10190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:25.579084 10190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:25.579129 10190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:25.583305 10190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:25.583362 10190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:25.583448 10190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:28:25.588689 10190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:25.589726 10190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:25.590833 10190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:25.600966 10204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:25.600994 10200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:25.600991 10201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:25.601276 10190 server_base.cc:1034] running on GCE node
I20260809 02:28:25.601747 10190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:25.602526 10190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:25.603705 10190 hybrid_clock.cc:648] HybridClock initialized: now 1786242505603685 us; error 30 us; skew 500 ppm
Aug 09 02:28:25 dist-test-slave-68xk krb5kdc[10048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242505, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:25.606619 10190 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:28:25.607437 10190 webserver.cc:460] Webserver started at http://127.21.214.129:43217/ using document root <none> and password file <none>
I20260809 02:28:25.607990 10190 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:25.608083 10190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:25.608325 10190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:28:25.610358 10190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "8eb286de36c241ebaaa23c397c5f66c7"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "ca01493635a6721a08a327ca0b069b20"
server_key_iv: "cfe2fb5f441f64cbc7aaac1b1cbc0030"
server_key_version: "encryptionkey@0"
I20260809 02:28:25.610970 10190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "8eb286de36c241ebaaa23c397c5f66c7"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "ca01493635a6721a08a327ca0b069b20"
server_key_iv: "cfe2fb5f441f64cbc7aaac1b1cbc0030"
server_key_version: "encryptionkey@0"
I20260809 02:28:25.614732 10190 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:28:25.617123 10216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:25.618445 10190 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:28:25.618585 10190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "8eb286de36c241ebaaa23c397c5f66c7"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "ca01493635a6721a08a327ca0b069b20"
server_key_iv: "cfe2fb5f441f64cbc7aaac1b1cbc0030"
server_key_version: "encryptionkey@0"
I20260809 02:28:25.618700 10190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:25.642287 10190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:25.645918 10190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:25.646142 10190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:25.647074 10190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:25.648185 10190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:25.648259 10190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:25.648331 10190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:25.648362 10190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:25.659483 10190 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:33519
I20260809 02:28:25.659567 10374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:33519 every 8 connection(s)
I20260809 02:28:25.660409 10190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:28:25.661125 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 10190
I20260809 02:28:25.661283 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:28:25.661641 22362 external_mini_cluster.cc:1428] Setting key e02b631c1f8c583022890de0212cb10a
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
Aug 09 02:28:25 dist-test-slave-68xk krb5kdc[10048](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242505, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
I20260809 02:28:25.678601 10165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:25.664108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:60109 (local address 127.21.214.190:45647)
0809 02:28:25.664277 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:25.664284 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:25.664302 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:28:25.665780 (+ 1478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:25.665785 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:25.665848 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:25.665943 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:25.667643 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:25.668310 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:25.670225 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:25.670629 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:25.670757 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:25.674499 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:25.674503 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:25.674505 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:25.674530 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:25.676159 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:25.676849 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:25.676854 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:25.676857 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:25.676948 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:25.677404 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:25.677411 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:25.677412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:25.677616 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:25.677734 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:25.678268 (+ 534us) server_negotiation.cc:299] Negotiation successful
0809 02:28:25.678404 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 02:28:25.679854 10379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:25.662994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:60109)
0809 02:28:25.663623 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:25.663687 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:25.665512 (+ 1825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:25.666165 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:25.666177 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:25.666728 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:25.667477 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:25.667500 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:25.668451 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:25.668458 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:25.670045 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:25.670060 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:25.671116 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:25.671127 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:25.671373 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:25.672103 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:25.672162 (+ 59us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:25.674220 (+ 2058us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:25.676301 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:25.676310 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:25.676330 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:25.676719 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:25.677112 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:25.677115 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:25.677117 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:25.677292 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:25.677735 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:25.677744 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:25.678008 (+ 264us) client_negotiation.cc:769] Sending connection context
0809 02:28:25.678213 (+ 205us) client_negotiation.cc:240] Negotiation successful
0809 02:28:25.678598 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":169,"threads_started":1}
I20260809 02:28:25.681561 10377 heartbeater.cc:347] Connected to a master server at 127.21.214.190:45647
I20260809 02:28:25.681895 10377 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:25.682618 10377 heartbeater.cc:511] Master 127.21.214.190:45647 requested a full tablet report, sending...
I20260809 02:28:25.684396 10108 ts_manager.cc:194] Registered new tserver with Master: 8eb286de36c241ebaaa23c397c5f66c7 (127.21.214.129:33519)
I20260809 02:28:25.685876 10108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:60109
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:28:25.698606 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45647
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:43643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:25.816072 10386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:25.816327 10386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:25.816368 10386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:25.820295 10386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:25.820351 10386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:25.820407 10386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:28:25.825692 10386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:25.826742 10386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:25.827710 10386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:25.837678 10395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:25.837678 10391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:25.838562 10392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:25.839107 10386 server_base.cc:1034] running on GCE node
I20260809 02:28:25.839550 10386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:25.840221 10386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:25.841385 10386 hybrid_clock.cc:648] HybridClock initialized: now 1786242505841352 us; error 44 us; skew 500 ppm
Aug 09 02:28:25 dist-test-slave-68xk krb5kdc[10048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242505, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:25.844841 10386 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:28:25.846294 10386 webserver.cc:460] Webserver started at http://127.21.214.130:34825/ using document root <none> and password file <none>
I20260809 02:28:25.847211 10386 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:25.847326 10386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:25.847663 10386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:28:25.849958 10386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "19e5adfc4e3e4b0785b031462de47477"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "8c600b7ed4f016d7d88314b8ce179c89"
server_key_iv: "dc8be081e24d7070598904382ec8f731"
server_key_version: "encryptionkey@0"
I20260809 02:28:25.850677 10386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "19e5adfc4e3e4b0785b031462de47477"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "8c600b7ed4f016d7d88314b8ce179c89"
server_key_iv: "dc8be081e24d7070598904382ec8f731"
server_key_version: "encryptionkey@0"
I20260809 02:28:25.855212 10386 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 02:28:25.858089 10407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:25.859464 10386 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:28:25.859622 10386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "19e5adfc4e3e4b0785b031462de47477"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "8c600b7ed4f016d7d88314b8ce179c89"
server_key_iv: "dc8be081e24d7070598904382ec8f731"
server_key_version: "encryptionkey@0"
I20260809 02:28:25.859761 10386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:25.873574 10386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:25.876863 10386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:25.877094 10386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:25.877749 10386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:25.878772 10386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:25.878852 10386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:25.878934 10386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:25.878991 10386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:25.889494 10386 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:42735
I20260809 02:28:25.889520 10569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:42735 every 8 connection(s)
I20260809 02:28:25.890681 10386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:28:25.896384 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 10386
I20260809 02:28:25.896515 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:28:25.896807 22362 external_mini_cluster.cc:1428] Setting key a64a2154feda3cfdf2a93e92e43db6a3
Aug 09 02:28:25 dist-test-slave-68xk krb5kdc[10048](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242505, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:25.907532 10165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:25.892853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:51253 (local address 127.21.214.190:45647)
0809 02:28:25.893006 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:25.893010 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:25.893966 (+ 956us) server_negotiation.cc:407] Connection header received
0809 02:28:25.895518 (+ 1552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:25.895522 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:25.895593 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:25.895675 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:25.897310 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:25.897946 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:25.899352 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:25.899746 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:25.899881 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:25.902909 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:25.902916 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:25.902922 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:25.902957 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:25.904880 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:25.905620 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:25.905623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:25.905624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:25.905712 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:25.906200 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:25.906203 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:25.906204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:25.906388 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:25.906528 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:25.907266 (+ 738us) server_negotiation.cc:299] Negotiation successful
0809 02:28:25.907382 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:28:25.908699 10572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:25.893253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:51253)
0809 02:28:25.893788 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:25.893833 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:25.895287 (+ 1454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:25.895862 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:25.895869 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:25.896363 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:25.897078 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:25.897101 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:25.898163 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:25.898167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:25.899209 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:25.899219 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:25.899935 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:25.899938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:25.900151 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:25.900848 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:25.900874 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:25.902724 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:25.905054 (+ 2330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:25.905061 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:25.905077 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:25.905474 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:25.905815 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:25.905820 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:25.905825 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:25.906052 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:25.906577 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:25.906585 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:25.906935 (+ 350us) client_negotiation.cc:769] Sending connection context
0809 02:28:25.907164 (+ 229us) client_negotiation.cc:240] Negotiation successful
0809 02:28:25.907554 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":144,"threads_started":1}
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
I20260809 02:28:25.910130 10570 heartbeater.cc:347] Connected to a master server at 127.21.214.190:45647
I20260809 02:28:25.910395 10570 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:25.911052 10570 heartbeater.cc:511] Master 127.21.214.190:45647 requested a full tablet report, sending...
I20260809 02:28:25.912294 10108 ts_manager.cc:194] Registered new tserver with Master: 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130:42735)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
I20260809 02:28:25.913187 10108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:51253
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:28:25.930605 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45647
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:43643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:26.044450 10575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:26.044711 10575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:26.044754 10575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:26.048828 10575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:26.048887 10575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:26.048943 10575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:28:26.054098 10575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:45647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:26.055157 10575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:26.056298 10575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:28:26.066363 10575 server_base.cc:1034] running on GCE node
W20260809 02:28:26.066355 10584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:26.066320 10583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:26.066314 10586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:26.067073 10575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:26.067800 10575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:26.069029 10575 hybrid_clock.cc:648] HybridClock initialized: now 1786242506069008 us; error 31 us; skew 500 ppm
Aug 09 02:28:26 dist-test-slave-68xk krb5kdc[10048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242506, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:26.072618 10575 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:28:26.073531 10575 webserver.cc:460] Webserver started at http://127.21.214.131:42977/ using document root <none> and password file <none>
I20260809 02:28:26.074183 10575 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:26.074291 10575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:26.074618 10575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:28:26.077057 10575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "146b9bf425704a87aab9ccc16f1f4e36"
format_stamp: "Formatted at 2026-08-09 02:28:26 on dist-test-slave-68xk"
server_key: "ad63161ca4469e39f46b2f4024445b7b"
server_key_iv: "a9c7fc405d0d12526ccb013ef57d681a"
server_key_version: "encryptionkey@0"
I20260809 02:28:26.077659 10575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "146b9bf425704a87aab9ccc16f1f4e36"
format_stamp: "Formatted at 2026-08-09 02:28:26 on dist-test-slave-68xk"
server_key: "ad63161ca4469e39f46b2f4024445b7b"
server_key_iv: "a9c7fc405d0d12526ccb013ef57d681a"
server_key_version: "encryptionkey@0"
I20260809 02:28:26.081686 10575 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 02:28:26.084401 10595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:26.085688 10575 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:28:26.085844 10575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "146b9bf425704a87aab9ccc16f1f4e36"
format_stamp: "Formatted at 2026-08-09 02:28:26 on dist-test-slave-68xk"
server_key: "ad63161ca4469e39f46b2f4024445b7b"
server_key_iv: "a9c7fc405d0d12526ccb013ef57d681a"
server_key_version: "encryptionkey@0"
I20260809 02:28:26.085965 10575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:26.107402 10575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:26.111008 10575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:26.111250 10575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:26.111904 10575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:26.112798 10575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:26.112877 10575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:26.112957 10575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:26.113008 10575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:26.123462 10575 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:35257
I20260809 02:28:26.123487 10753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:35257 every 8 connection(s)
I20260809 02:28:26.124466 10575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:28:26.127882 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 10575
I20260809 02:28:26.128026 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:28:26.128320 22362 external_mini_cluster.cc:1428] Setting key 87493c368e6cb413de41056a0e6e7151
Aug 09 02:28:26 dist-test-slave-68xk krb5kdc[10048](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242506, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:26.139599 10165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.126428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:42677 (local address 127.21.214.190:45647)
0809 02:28:26.126583 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:26.126587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:26.127630 (+ 1043us) server_negotiation.cc:407] Connection header received
0809 02:28:26.129302 (+ 1672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:26.129305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:26.129369 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:26.129474 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:26.131112 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.131707 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.132879 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.133157 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.133252 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.135948 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:26.135951 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:26.135953 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:26.135981 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:26.137513 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:26.138017 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:26.138020 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:26.138021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:26.138145 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:26.138542 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:26.138545 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:26.138546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:26.138755 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:26.138848 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:26.139353 (+ 505us) server_negotiation.cc:299] Negotiation successful
0809 02:28:26.139462 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 02:28:26.140405 10756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.126898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:42677)
0809 02:28:26.127418 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:26.127463 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:26.129025 (+ 1562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:26.129751 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:26.129758 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:26.130297 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:26.130898 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.130922 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.131841 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.131844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.132744 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.132753 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.133300 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.133303 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.133445 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.134068 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:26.134085 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:26.135755 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:26.137629 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:26.137634 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:26.137645 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:26.137913 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:26.138231 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:26.138234 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:26.138235 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:26.138368 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:26.138855 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:26.138859 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:26.139084 (+ 225us) client_negotiation.cc:769] Sending connection context
0809 02:28:26.139267 (+ 183us) client_negotiation.cc:240] Negotiation successful
0809 02:28:26.139517 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":116,"threads_started":1}
I20260809 02:28:26.141731 10754 heartbeater.cc:347] Connected to a master server at 127.21.214.190:45647
I20260809 02:28:26.141991 10754 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:26.142643 10754 heartbeater.cc:511] Master 127.21.214.190:45647 requested a full tablet report, sending...
I20260809 02:28:26.143720 10108 ts_manager.cc:194] Registered new tserver with Master: 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257)
I20260809 02:28:26.144274 10108 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:42677
I20260809 02:28:26.154907 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:28:26.164839 10165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.157266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56464 (local address 127.21.214.190:45647)
0809 02:28:26.157423 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:26.157427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:26.157578 (+ 151us) server_negotiation.cc:407] Connection header received
0809 02:28:26.157694 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:26.157696 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:26.157734 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:26.157800 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:26.158626 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.159123 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.160035 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.160249 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.160327 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.161752 (+ 1425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:26.161755 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:26.161757 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:26.161779 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:26.163211 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:26.163712 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:26.163714 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:26.163715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:26.163794 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:26.164037 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:26.164039 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:26.164040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:26.164245 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:26.164350 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:26.164555 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 02:28:26.164696 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:28:26.167807 10108 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56464:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:28:26.170974 10108 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:28:26.185738 10770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.180015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:35257 (local address 127.0.0.1:53354)
0809 02:28:26.180461 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:26.180514 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:26.180656 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:26.181461 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:26.181467 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:26.181491 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:26.181642 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.181650 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.183054 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.183060 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.184012 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.184021 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.185112 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.185116 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.185301 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.185349 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 02:28:26.185458 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 02:28:26.185579 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":20,"thread_start_us":98,"threads_started":1}
I20260809 02:28:26.185784 10771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.180146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53354 (local address 127.21.214.131:35257)
0809 02:28:26.180895 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:26.180927 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:26.180955 (+ 28us) server_negotiation.cc:407] Connection header received
0809 02:28:26.181039 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:26.181044 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:26.181275 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:26.181474 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:26.181811 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.182925 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.184155 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.184979 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.185130 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.185271 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:26.185520 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 02:28:26.185626 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":221,"threads_started":1}
I20260809 02:28:26.186826 10772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.180809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:42735 (local address 127.0.0.1:35580)
0809 02:28:26.181553 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:26.181569 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:26.181654 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:26.182472 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:26.182475 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:26.182494 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:26.182588 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.182593 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.183983 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.183988 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.185213 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.185224 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.186339 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.186343 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.186480 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.186541 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 02:28:26.186615 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 02:28:26.186685 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"mutex_wait_us":23,"thread_start_us":110,"threads_started":1}
I20260809 02:28:26.186913 10773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.181045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35580 (local address 127.21.214.130:42735)
0809 02:28:26.181924 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:26.181939 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:26.181962 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:28:26.182046 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:26.182052 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:26.182262 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:26.182486 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:26.182693 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.183819 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.185366 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.186199 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.186331 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.186493 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:26.186665 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 02:28:26.186760 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":769,"thread_start_us":95,"threads_started":1}
I20260809 02:28:26.187959 10769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.180053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:33519 (local address 127.0.0.1:43480)
0809 02:28:26.181122 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:26.181136 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:26.181231 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:26.182220 (+ 989us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:26.182223 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:26.182242 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:26.182363 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.182371 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.183948 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.183952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.185176 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.185186 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.186491 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.186494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.186831 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.186863 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 02:28:26.187762 (+ 899us) client_negotiation.cc:240] Negotiation successful
0809 02:28:26.187838 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1003,"mutex_wait_us":276,"thread_start_us":112,"threads_started":1}
I20260809 02:28:26.188550 10774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.181057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43480 (local address 127.21.214.129:33519)
0809 02:28:26.181774 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:26.181783 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:26.181807 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:28:26.181885 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:26.181890 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:26.182073 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:26.182232 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:26.182574 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.183801 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.185317 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.186332 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.186564 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.186709 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:26.188314 (+ 1605us) server_negotiation.cc:299] Negotiation successful
0809 02:28:26.188413 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":133,"threads_started":1}
I20260809 02:28:26.189215 10673 tablet_service.cc:1467] Processing CreateTablet for tablet 3cf9e03217bd404eac2fb08e8090ba63 (DEFAULT_TABLE table=test-table [id=c848b3e4194d4f1c88195532757b32b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:28:26.189692 10478 tablet_service.cc:1467] Processing CreateTablet for tablet 3cf9e03217bd404eac2fb08e8090ba63 (DEFAULT_TABLE table=test-table [id=c848b3e4194d4f1c88195532757b32b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:28:26.190514 10673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cf9e03217bd404eac2fb08e8090ba63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:26.190768 10478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cf9e03217bd404eac2fb08e8090ba63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:26.191231 10280 tablet_service.cc:1467] Processing CreateTablet for tablet 3cf9e03217bd404eac2fb08e8090ba63 (DEFAULT_TABLE table=test-table [id=c848b3e4194d4f1c88195532757b32b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:28:26.192209 10280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cf9e03217bd404eac2fb08e8090ba63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:26.196914 10775 tablet_bootstrap.cc:492] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477: Bootstrap starting.
I20260809 02:28:26.198453 10780 tablet_bootstrap.cc:492] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36: Bootstrap starting.
I20260809 02:28:26.199419 10782 tablet_bootstrap.cc:492] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Bootstrap starting.
I20260809 02:28:26.201081 10775 tablet_bootstrap.cc:654] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:26.201102 10780 tablet_bootstrap.cc:654] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:26.201267 10782 tablet_bootstrap.cc:654] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:26.202024 10782 log.cc:824] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:26.202021 10775 log.cc:824] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:26.202021 10780 log.cc:824] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:26.203879 10775 tablet_bootstrap.cc:492] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477: No bootstrap required, opened a new log
I20260809 02:28:26.204064 10780 tablet_bootstrap.cc:492] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36: No bootstrap required, opened a new log
I20260809 02:28:26.204064 10782 tablet_bootstrap.cc:492] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: No bootstrap required, opened a new log
I20260809 02:28:26.204097 10775 ts_tablet_manager.cc:1397] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 02:28:26.204258 10780 ts_tablet_manager.cc:1397] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260809 02:28:26.204258 10782 ts_tablet_manager.cc:1397] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 02:28:26.207369 10775 raft_consensus.cc:348] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } }
I20260809 02:28:26.207619 10775 raft_consensus.cc:374] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:26.207685 10775 raft_consensus.cc:729] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19e5adfc4e3e4b0785b031462de47477, State: Initialized, Role: FOLLOWER
I20260809 02:28:26.208123 10775 consensus_queue.cc:260] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } }
I20260809 02:28:26.208357 10780 raft_consensus.cc:348] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } }
I20260809 02:28:26.208626 10780 raft_consensus.cc:374] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:26.208698 10780 raft_consensus.cc:729] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146b9bf425704a87aab9ccc16f1f4e36, State: Initialized, Role: FOLLOWER
I20260809 02:28:26.208738 10782 raft_consensus.cc:348] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } }
I20260809 02:28:26.208999 10570 heartbeater.cc:503] Master 127.21.214.190:45647 was elected leader, sending a full tablet report...
I20260809 02:28:26.209012 10782 raft_consensus.cc:374] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:26.209064 10782 raft_consensus.cc:729] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eb286de36c241ebaaa23c397c5f66c7, State: Initialized, Role: FOLLOWER
I20260809 02:28:26.209240 10775 ts_tablet_manager.cc:1428] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:28:26.209201 10780 consensus_queue.cc:260] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } }
I20260809 02:28:26.209497 10782 consensus_queue.cc:260] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } }
I20260809 02:28:26.209961 10754 heartbeater.cc:503] Master 127.21.214.190:45647 was elected leader, sending a full tablet report...
I20260809 02:28:26.210189 10780 ts_tablet_manager.cc:1428] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36: Time spent starting tablet: real 0.006s user 0.005s sys 0.002s
I20260809 02:28:26.210469 10782 ts_tablet_manager.cc:1428] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260809 02:28:26.210789 10377 heartbeater.cc:503] Master 127.21.214.190:45647 was elected leader, sending a full tablet report...
I20260809 02:28:26.221365 10792 raft_consensus.cc:482] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:28:26.221550 10792 raft_consensus.cc:504] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } }
I20260809 02:28:26.222754 10792 leader_election.cc:288] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257), 8eb286de36c241ebaaa23c397c5f66c7 (127.21.214.129:33519)
I20260809 02:28:26.226567 10774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.223127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:56799 (local address 127.21.214.129:33519)
0809 02:28:26.223247 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:26.223250 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:26.223264 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:28:26.223335 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:26.223337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:26.223374 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:26.223499 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:26.223815 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.224450 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.225539 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.225968 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.226115 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.226170 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:26.226359 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 02:28:26.226459 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 02:28:26.226567 10572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.223022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:33519 (local address 127.21.214.130:56799)
0809 02:28:26.223133 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:26.223152 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:26.223242 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:26.223522 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:26.223526 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:26.223546 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:26.223686 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.223692 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.224602 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.224606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.225393 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.225403 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.226103 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.226107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.226218 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.226248 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 02:28:26.226340 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 02:28:26.226417 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260809 02:28:26.227129 10771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.223112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:38805 (local address 127.21.214.131:35257)
0809 02:28:26.223241 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:26.223246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:26.223832 (+ 586us) server_negotiation.cc:407] Connection header received
0809 02:28:26.223980 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:26.223983 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:26.224031 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:26.224165 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:26.224443 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.224925 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.225987 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.226385 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.226541 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.226587 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:26.226948 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 02:28:26.227017 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:28:26.227142 10795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.223022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:35257 (local address 127.21.214.130:38805)
0809 02:28:26.223727 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:26.223739 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:26.223860 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:26.224176 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:26.224179 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:26.224197 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:26.224327 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.224332 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.225053 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.225058 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.225849 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.225859 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.226541 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.226544 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.226813 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.226842 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 02:28:26.226927 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 02:28:26.226998 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"mutex_wait_us":309,"thread_start_us":172,"threads_started":1}
I20260809 02:28:26.227142 10306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cf9e03217bd404eac2fb08e8090ba63" candidate_uuid: "19e5adfc4e3e4b0785b031462de47477" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eb286de36c241ebaaa23c397c5f66c7" is_pre_election: true
I20260809 02:28:26.227483 10306 raft_consensus.cc:2454] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19e5adfc4e3e4b0785b031462de47477 in term 0.
I20260809 02:28:26.227777 10701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cf9e03217bd404eac2fb08e8090ba63" candidate_uuid: "19e5adfc4e3e4b0785b031462de47477" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146b9bf425704a87aab9ccc16f1f4e36" is_pre_election: true
I20260809 02:28:26.228004 10413 leader_election.cc:302] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19e5adfc4e3e4b0785b031462de47477, 8eb286de36c241ebaaa23c397c5f66c7; no voters:
I20260809 02:28:26.228080 10701 raft_consensus.cc:2454] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19e5adfc4e3e4b0785b031462de47477 in term 0.
I20260809 02:28:26.228339 10792 raft_consensus.cc:2781] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:28:26.228461 10792 raft_consensus.cc:482] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:28:26.228513 10792 raft_consensus.cc:3037] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:26.229617 10792 raft_consensus.cc:504] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } }
I20260809 02:28:26.229971 10792 leader_election.cc:288] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [CANDIDATE]: Term 1 election: Requested vote from peers 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257), 8eb286de36c241ebaaa23c397c5f66c7 (127.21.214.129:33519)
I20260809 02:28:26.230372 10701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cf9e03217bd404eac2fb08e8090ba63" candidate_uuid: "19e5adfc4e3e4b0785b031462de47477" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146b9bf425704a87aab9ccc16f1f4e36"
I20260809 02:28:26.230545 10701 raft_consensus.cc:3037] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:26.230535 10306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cf9e03217bd404eac2fb08e8090ba63" candidate_uuid: "19e5adfc4e3e4b0785b031462de47477" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eb286de36c241ebaaa23c397c5f66c7"
I20260809 02:28:26.230696 10306 raft_consensus.cc:3037] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:26.231983 10701 raft_consensus.cc:2454] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19e5adfc4e3e4b0785b031462de47477 in term 1.
I20260809 02:28:26.232169 10306 raft_consensus.cc:2454] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19e5adfc4e3e4b0785b031462de47477 in term 1.
I20260809 02:28:26.232326 10412 leader_election.cc:302] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146b9bf425704a87aab9ccc16f1f4e36, 19e5adfc4e3e4b0785b031462de47477; no voters:
I20260809 02:28:26.232527 10792 raft_consensus.cc:2781] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:28:26.232782 10792 raft_consensus.cc:686] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [term 1 LEADER]: Becoming Leader. State: Replica: 19e5adfc4e3e4b0785b031462de47477, State: Running, Role: LEADER
I20260809 02:28:26.233103 10792 consensus_queue.cc:237] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } }
I20260809 02:28:26.236616 10107 catalog_manager.cc:5495] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130). New cstate: current_term: 1 leader_uuid: "19e5adfc4e3e4b0785b031462de47477" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } health_report { overall_health: HEALTHY } } }
I20260809 02:28:26.252173 10773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.248935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35588 (local address 127.21.214.130:42735)
0809 02:28:26.249072 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:26.249076 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:26.249088 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:28:26.249192 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:26.249194 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:26.249244 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:26.249331 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:28:26.249513 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.250002 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.250930 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.251138 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.251238 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.251476 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:28:26.251856 (+ 380us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:28:26.251947 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:26.252002 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 02:28:26.252048 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:28:26.258116 10306 raft_consensus.cc:1261] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Refusing update from remote peer 19e5adfc4e3e4b0785b031462de47477: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:28:26.258147 10701 raft_consensus.cc:1261] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36 [term 1 FOLLOWER]: Refusing update from remote peer 19e5adfc4e3e4b0785b031462de47477: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:28:26.258924 10796 consensus_queue.cc:1035] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:28:26.259116 10792 consensus_queue.cc:1035] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:28:26.270208 10802 mvcc.cc:205] Tried to move back new op lower bound from 7316449305625538560 to 7316449305533296640. Current Snapshot: MvccSnapshot[applied={T|T < 7316449305625538560}]
I20260809 02:28:26.276611 10109 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:28:26.276774 10109 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:28:26.279433 10109 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Sending DeleteTablet for 3 replicas of tablet 3cf9e03217bd404eac2fb08e8090ba63
I20260809 02:28:26.280323 10280 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cf9e03217bd404eac2fb08e8090ba63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:26 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:43480
I20260809 02:28:26.280324 10673 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cf9e03217bd404eac2fb08e8090ba63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:26 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:53354
I20260809 02:28:26.280936 10812 tablet_replica.cc:330] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36: stopping tablet replica
I20260809 02:28:26.281136 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 10190
I20260809 02:28:26.281138 10478 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cf9e03217bd404eac2fb08e8090ba63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:26 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:35580
I20260809 02:28:26.313673 10812 raft_consensus.cc:2229] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:28:26.314198 10812 raft_consensus.cc:2258] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:28:26.317185 10812 ts_tablet_manager.cc:1905] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:28:26.317633 10814 tablet_replica.cc:330] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477: stopping tablet replica
I20260809 02:28:26.318044 10814 raft_consensus.cc:2229] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:28:26.318552 10814 raft_consensus.cc:2258] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:28:26.320209 10814 ts_tablet_manager.cc:1905] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:28:26.321503 10812 ts_tablet_manager.cc:1918] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:28:26.321635 10812 log.cc:1196] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/3cf9e03217bd404eac2fb08e8090ba63
I20260809 02:28:26.322039 10812 ts_tablet_manager.cc:1939] T 3cf9e03217bd404eac2fb08e8090ba63 P 146b9bf425704a87aab9ccc16f1f4e36: Deleting consensus metadata
I20260809 02:28:26.323542 10092 catalog_manager.cc:4841] TS 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257): tablet 3cf9e03217bd404eac2fb08e8090ba63 (table test-table [id=c848b3e4194d4f1c88195532757b32b6]) successfully deleted
I20260809 02:28:26.323637 10814 ts_tablet_manager.cc:1918] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:28:26.323884 10814 log.cc:1196] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/3cf9e03217bd404eac2fb08e8090ba63
I20260809 02:28:26.324285 10814 ts_tablet_manager.cc:1939] T 3cf9e03217bd404eac2fb08e8090ba63 P 19e5adfc4e3e4b0785b031462de47477: Deleting consensus metadata
W20260809 02:28:26.324704 10093 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:33519 (error 108)
I20260809 02:28:26.325449 10092 catalog_manager.cc:4841] TS 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130:42735): tablet 3cf9e03217bd404eac2fb08e8090ba63 (table test-table [id=c848b3e4194d4f1c88195532757b32b6]) successfully deleted
I20260809 02:28:26.325820 10769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.325489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:33519 (local address 127.0.0.1:43492)
0809 02:28:26.325639 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:26.325726 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:33519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 02:28:26.325959 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 10386
W20260809 02:28:26.326043 10093 catalog_manager.cc:4584] TS 8eb286de36c241ebaaa23c397c5f66c7 (127.21.214.129:33519): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3cf9e03217bd404eac2fb08e8090ba63: Network error: Client connection negotiation failed: client connection to 127.21.214.129:33519: connect: Connection refused (error 111)
I20260809 02:28:26.335638 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 10575
I20260809 02:28:26.349071 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 10068
I20260809 02:28:26.361716 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:45647
--webserver_interface=127.21.214.190
--webserver_port=46489
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:43643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:45647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:26.473244 10817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:26.473531 10817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:26.473605 10817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:26.477514 10817 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:28:26.477600 10817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:26.477635 10817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:26.477675 10817 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:28:26.477707 10817 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:28:26.482801 10817 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:45647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:45647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=46489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:26.483829 10817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:26.484839 10817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:26.499274 10830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:26.499261 10832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:26.499300 10835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:26.499689 10817 server_base.cc:1034] running on GCE node
I20260809 02:28:26.500463 10817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:26.501616 10817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:26.502807 10817 hybrid_clock.cc:648] HybridClock initialized: now 1786242506502794 us; error 35 us; skew 500 ppm
Aug 09 02:28:26 dist-test-slave-68xk krb5kdc[10048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242506, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:26.505636 10817 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:28:26.506619 10817 webserver.cc:460] Webserver started at http://127.21.214.190:46489/ using document root <none> and password file <none>
I20260809 02:28:26.507170 10817 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:26.507243 10817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:26.511000 10817 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 02:28:26.513115 10847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:26.514338 10817 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:28:26.514493 10817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "73fe5b6cd6834949855d08535df89ccc"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "aa10dabaeef311eb69e95610d6e64869"
server_key_iv: "5c125ad406d0033e1f7888574b3ece10"
server_key_version: "encryptionkey@0"
I20260809 02:28:26.515066 10817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:26.528216 10817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:26.531375 10817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:26.531579 10817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:26.538784 10817 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:45647
I20260809 02:28:26.539067 10911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:45647 every 8 connection(s)
I20260809 02:28:26.539883 10817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:28:26.544241 10912 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:28:26.545874 10912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Bootstrap starting.
I20260809 02:28:26.548807 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 10817
I20260809 02:28:26.549345 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:33519
--local_ip_for_outbound_sockets=127.21.214.129
--tserver_master_addrs=127.21.214.190:45647
--webserver_port=43217
--webserver_interface=127.21.214.129
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:43643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:28:26.565342 10912 log.cc:824] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:26.574129 10912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:28:26.574573 10912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Bootstrap complete.
I20260809 02:28:26.578889 10912 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } }
I20260809 02:28:26.579281 10912 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73fe5b6cd6834949855d08535df89ccc, State: Initialized, Role: FOLLOWER
I20260809 02:28:26.579769 10912 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } }
I20260809 02:28:26.579880 10912 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:28:26.579975 10912 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:28:26.580085 10912 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:28:26.581970 10912 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } }
I20260809 02:28:26.582305 10912 leader_election.cc:302] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73fe5b6cd6834949855d08535df89ccc; no voters:
I20260809 02:28:26.582705 10912 leader_election.cc:288] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:28:26.582751 10917 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:28:26.582969 10917 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 2 LEADER]: Becoming Leader. State: Replica: 73fe5b6cd6834949855d08535df89ccc, State: Running, Role: LEADER
I20260809 02:28:26.583271 10917 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } }
I20260809 02:28:26.583972 10912 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:28:26.584292 10918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "73fe5b6cd6834949855d08535df89ccc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } } }
I20260809 02:28:26.584421 10918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:26.584750 10919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73fe5b6cd6834949855d08535df89ccc. Latest consensus state: current_term: 2 leader_uuid: "73fe5b6cd6834949855d08535df89ccc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } } }
I20260809 02:28:26.584868 10919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:26.585280 10921 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:28:26.590341 10921 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:28:26.591046 10921 catalog_manager.cc:1259] Loaded cluster ID: 6abc73f7b94f47ec84cec921656d6104
I20260809 02:28:26.591126 10921 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:28:26.592268 10921 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 02:28:26.595131 10921 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 02:28:26.599874 10921 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:28:26.600509 10921 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Loaded TSK: 0
I20260809 02:28:26.601469 10921 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:28:26.678634 10915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:26.678925 10915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:26.679008 10915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:26.683044 10915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:26.683138 10915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:26.683240 10915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:28:26.689096 10915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:33519
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=43217
--tserver_master_addrs=127.21.214.190:45647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:26.690168 10915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:26.691288 10915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:26.701126 10952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:26.701138 10953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:26.701516 10956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:26.701810 10915 server_base.cc:1034] running on GCE node
I20260809 02:28:26.702221 10915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:26.702907 10915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:26.704123 10915 hybrid_clock.cc:648] HybridClock initialized: now 1786242506704099 us; error 52 us; skew 500 ppm
Aug 09 02:28:26 dist-test-slave-68xk krb5kdc[10048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242506, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:26.707178 10915 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:28:26.708184 10915 webserver.cc:460] Webserver started at http://127.21.214.129:43217/ using document root <none> and password file <none>
I20260809 02:28:26.708766 10915 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:26.708877 10915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:26.712879 10915 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260809 02:28:26.715077 10967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:26.716370 10915 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:28:26.716468 10915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "8eb286de36c241ebaaa23c397c5f66c7"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "ca01493635a6721a08a327ca0b069b20"
server_key_iv: "cfe2fb5f441f64cbc7aaac1b1cbc0030"
server_key_version: "encryptionkey@0"
I20260809 02:28:26.717074 10915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:26.746132 10915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:26.749248 10915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:26.749468 10915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:26.750130 10915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:26.751340 10977 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:28:26.756191 10915 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:28:26.756271 10915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260809 02:28:26.756354 10915 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:28:26.758193 10915 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:28:26.758262 10915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 02:28:26.758637 10977 tablet_bootstrap.cc:492] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Bootstrap starting.
I20260809 02:28:26.769487 10915 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:33519
I20260809 02:28:26.769608 11121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:33519 every 8 connection(s)
I20260809 02:28:26.770574 10915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:28:26.778060 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 10915
I20260809 02:28:26.778550 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:42735
--local_ip_for_outbound_sockets=127.21.214.130
--tserver_master_addrs=127.21.214.190:45647
--webserver_port=34825
--webserver_interface=127.21.214.130
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:43643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:28:26.781097 10977 log.cc:824] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:28:26 dist-test-slave-68xk krb5kdc[10048](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242506, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:26.790030 10977 tablet_bootstrap.cc:492] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:28:26.790524 10977 tablet_bootstrap.cc:492] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Bootstrap complete.
I20260809 02:28:26.791610 11125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.772976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:34301 (local address 127.21.214.190:45647)
0809 02:28:26.773618 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:26.773639 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:26.773691 (+ 52us) server_negotiation.cc:407] Connection header received
0809 02:28:26.774823 (+ 1132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:26.774848 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:26.775342 (+ 494us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:26.775747 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:26.777039 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.778843 (+ 1804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.780602 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.781402 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.781598 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.784956 (+ 3358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:26.784962 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:26.784978 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:26.785012 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:26.787329 (+ 2317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:26.788130 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:26.788136 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:26.788142 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:26.788299 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:26.788793 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:26.788796 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:26.788798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:26.789231 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:26.789370 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:26.790253 (+ 883us) server_negotiation.cc:299] Negotiation successful
0809 02:28:26.790725 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":154,"threads_started":1}
I20260809 02:28:26.791662 11124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.772896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:34301)
0809 02:28:26.773396 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:26.773452 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:26.774285 (+ 833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:26.775794 (+ 1509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:26.775800 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:26.776141 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:26.776794 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.776818 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.779060 (+ 2242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.779064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.780457 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.780469 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.781576 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.781583 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.781809 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.782620 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:26.782649 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:26.784667 (+ 2018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:26.787478 (+ 2811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:26.787488 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:26.787505 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:26.787982 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:26.788423 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:26.788430 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:26.788436 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:26.788670 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:26.789381 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:26.789389 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:26.789755 (+ 366us) client_negotiation.cc:769] Sending connection context
0809 02:28:26.790015 (+ 260us) client_negotiation.cc:240] Negotiation successful
0809 02:28:26.790452 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":195,"threads_started":1}
I20260809 02:28:26.792172 10977 ts_tablet_manager.cc:1397] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Time spent bootstrapping tablet: real 0.034s user 0.013s sys 0.018s
I20260809 02:28:26.794780 11122 heartbeater.cc:347] Connected to a master server at 127.21.214.190:45647
I20260809 02:28:26.795061 11122 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:26.794776 10977 raft_consensus.cc:348] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } }
I20260809 02:28:26.795387 10977 raft_consensus.cc:729] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eb286de36c241ebaaa23c397c5f66c7, State: Initialized, Role: FOLLOWER
I20260809 02:28:26.795810 11122 heartbeater.cc:511] Master 127.21.214.190:45647 requested a full tablet report, sending...
I20260809 02:28:26.795899 10977 consensus_queue.cc:260] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } }
I20260809 02:28:26.796901 10977 ts_tablet_manager.cc:1428] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260809 02:28:26.798688 10867 ts_manager.cc:194] Registered new tserver with Master: 8eb286de36c241ebaaa23c397c5f66c7 (127.21.214.129:33519)
I20260809 02:28:26.801870 10867 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:34301
I20260809 02:28:26.804301 11122 heartbeater.cc:503] Master 127.21.214.190:45647 was elected leader, sending a full tablet report...
Aug 09 02:28:26 dist-test-slave-68xk krb5kdc[10048](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242506, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for kudu/127.21.214.129@KRBTEST.COM
I20260809 02:28:26.812232 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.801524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43506 (local address 127.21.214.129:33519)
0809 02:28:26.802317 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:26.802329 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:26.802351 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:28:26.802436 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:26.802441 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:26.802641 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:26.802822 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:26.803611 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.804606 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.805786 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.806191 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.806316 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.808615 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:26.808624 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:26.808634 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:26.808661 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:26.810213 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:26.810801 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:26.810807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:26.810808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:26.810885 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:26.811204 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:26.811208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:26.811210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:26.811450 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:26.811597 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:26.811933 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 02:28:26.812091 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":702,"thread_start_us":104,"threads_started":1}
I20260809 02:28:26.812230 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:26.801449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:33519 (local address 127.0.0.1:43506)
0809 02:28:26.801848 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:26.801894 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:26.802022 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:26.802852 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:26.802859 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:26.803327 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:26.803463 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.803472 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.804742 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.804747 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.805676 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:26.805688 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:26.806330 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:26.806334 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:26.806506 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:26.807090 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:26.807103 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:26.808464 (+ 1361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:26.810333 (+ 1869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:26.810344 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:26.810350 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:26.810655 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:26.810997 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:26.811000 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:26.811002 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:26.811090 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:26.811574 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:26.811580 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:26.811705 (+ 125us) client_negotiation.cc:769] Sending connection context
0809 02:28:26.811848 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 02:28:26.812039 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":120,"threads_started":1}
I20260809 02:28:26.813405 11030 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cf9e03217bd404eac2fb08e8090ba63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:26 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:43506
I20260809 02:28:26.814296 11133 tablet_replica.cc:330] stopping tablet replica
I20260809 02:28:26.814670 11133 raft_consensus.cc:2229] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:28:26.814949 11133 raft_consensus.cc:2258] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:28:26.816219 11133 ts_tablet_manager.cc:1905] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:28:26.821223 11133 ts_tablet_manager.cc:1918] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:28:26.821343 11133 log.cc:1196] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal/wals/3cf9e03217bd404eac2fb08e8090ba63
I20260809 02:28:26.821650 11133 ts_tablet_manager.cc:1939] T 3cf9e03217bd404eac2fb08e8090ba63 P 8eb286de36c241ebaaa23c397c5f66c7: Deleting consensus metadata
I20260809 02:28:26.823874 10852 catalog_manager.cc:4841] TS 8eb286de36c241ebaaa23c397c5f66c7 (127.21.214.129:33519): tablet 3cf9e03217bd404eac2fb08e8090ba63 (table test-table [id=c848b3e4194d4f1c88195532757b32b6]) successfully deleted
W20260809 02:28:26.917855 11126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:26.918103 11126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:26.918145 11126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:26.922233 11126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:26.922293 11126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:26.922350 11126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:28:26.927664 11126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:42735
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=34825
--tserver_master_addrs=127.21.214.190:45647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:26.928699 11126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:26.929729 11126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:26.939404 11139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:26.939410 11140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:26.939415 11143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:26.939704 11126 server_base.cc:1034] running on GCE node
I20260809 02:28:26.940155 11126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:26.940757 11126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:26.941962 11126 hybrid_clock.cc:648] HybridClock initialized: now 1786242506941943 us; error 31 us; skew 500 ppm
Aug 09 02:28:26 dist-test-slave-68xk krb5kdc[10048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242506, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:26.944964 11126 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:28:26.945847 11126 webserver.cc:460] Webserver started at http://127.21.214.130:34825/ using document root <none> and password file <none>
I20260809 02:28:26.946393 11126 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:26.946542 11126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:26.950771 11126 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:28:26.952945 11153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:26.954339 11126 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:28:26.954530 11126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "19e5adfc4e3e4b0785b031462de47477"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "8c600b7ed4f016d7d88314b8ce179c89"
server_key_iv: "dc8be081e24d7070598904382ec8f731"
server_key_version: "encryptionkey@0"
I20260809 02:28:26.955085 11126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:26.985872 11126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:26.988901 11126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:26.989115 11126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:26.989687 11126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:26.990600 11126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:26.990649 11126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:26.990691 11126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:26.990715 11126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:27.001121 11126 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:42735
I20260809 02:28:27.001246 11305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:42735 every 8 connection(s)
I20260809 02:28:27.002219 11126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:28:27.008961 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 11126
I20260809 02:28:27.009490 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:35257
--local_ip_for_outbound_sockets=127.21.214.131
--tserver_master_addrs=127.21.214.190:45647
--webserver_port=42977
--webserver_interface=127.21.214.131
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:43643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:28:27 dist-test-slave-68xk krb5kdc[10048](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242506, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:27.020345 11125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.004282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:48131 (local address 127.21.214.190:45647)
0809 02:28:27.004449 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:27.004459 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:27.005310 (+ 851us) server_negotiation.cc:407] Connection header received
0809 02:28:27.007554 (+ 2244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:27.007561 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:27.007645 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:27.007756 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:27.009797 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.010730 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.012766 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.013057 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.013190 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.016119 (+ 2929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:27.016122 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:27.016125 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:27.016152 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:27.017802 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:27.018391 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:27.018395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:27.018397 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:27.018540 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:27.019021 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:27.019026 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:27.019028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:27.019243 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:27.019366 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:27.019979 (+ 613us) server_negotiation.cc:299] Negotiation successful
0809 02:28:27.020148 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 02:28:27.021387 11310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.004527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:48131)
0809 02:28:27.005074 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:27.005168 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:27.007220 (+ 2052us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:27.008027 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:27.008036 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:27.008759 (+ 723us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:27.009579 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:27.009606 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.010921 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.010925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:27.012608 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:27.012619 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.013242 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.013247 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:27.013444 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.014161 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:27.014180 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:27.015911 (+ 1731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:27.017944 (+ 2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:27.017950 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:27.017968 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:27.018272 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:27.018725 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:27.018732 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:27.018735 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:27.018905 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:27.019365 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:27.019375 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:27.019712 (+ 337us) client_negotiation.cc:769] Sending connection context
0809 02:28:27.019931 (+ 219us) client_negotiation.cc:240] Negotiation successful
0809 02:28:27.020298 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":110,"threads_started":1}
I20260809 02:28:27.022887 11307 heartbeater.cc:347] Connected to a master server at 127.21.214.190:45647
I20260809 02:28:27.023186 11307 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:27.023744 11307 heartbeater.cc:511] Master 127.21.214.190:45647 requested a full tablet report, sending...
I20260809 02:28:27.024925 10867 ts_manager.cc:194] Registered new tserver with Master: 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130:42735)
I20260809 02:28:27.025601 10867 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:48131
W20260809 02:28:27.127170 11313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:27.127437 11313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:27.127506 11313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:27.131471 11313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:27.131554 11313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:27.131649 11313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:28:27.136950 11313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:35257
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=42977
--tserver_master_addrs=127.21.214.190:45647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:27.137969 11313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:27.139055 11313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:27.148504 11323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:27.148511 11325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:27.148510 11322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:27.148715 11313 server_base.cc:1034] running on GCE node
I20260809 02:28:27.149187 11313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:27.149893 11313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:27.151100 11313 hybrid_clock.cc:648] HybridClock initialized: now 1786242507151088 us; error 31 us; skew 500 ppm
Aug 09 02:28:27 dist-test-slave-68xk krb5kdc[10048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242507, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:27.153774 11313 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:28:27.154630 11313 webserver.cc:460] Webserver started at http://127.21.214.131:42977/ using document root <none> and password file <none>
I20260809 02:28:27.155189 11313 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:27.155265 11313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:27.159153 11313 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260809 02:28:27.161170 11334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:27.162400 11313 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:28:27.162637 11313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "146b9bf425704a87aab9ccc16f1f4e36"
format_stamp: "Formatted at 2026-08-09 02:28:26 on dist-test-slave-68xk"
server_key: "ad63161ca4469e39f46b2f4024445b7b"
server_key_iv: "a9c7fc405d0d12526ccb013ef57d681a"
server_key_version: "encryptionkey@0"
I20260809 02:28:27.163185 11313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:27.199249 11313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:27.202728 11313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:27.203020 11313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:27.203827 11313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:27.204771 11313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:27.204851 11313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:27.204927 11313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:27.204962 11313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:27.214902 11313 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:35257
I20260809 02:28:27.214927 11508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:35257 every 8 connection(s)
I20260809 02:28:27.215934 11313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:28:27.218197 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 11313
Aug 09 02:28:27 dist-test-slave-68xk krb5kdc[10048](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242507, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:27.228065 11514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.219038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56468 (local address 127.21.214.190:45647)
0809 02:28:27.219320 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:27.219327 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:27.219631 (+ 304us) server_negotiation.cc:407] Connection header received
0809 02:28:27.219744 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:27.219748 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:27.219806 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:27.219914 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:27.220747 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.221581 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.222607 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.222831 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.222910 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.224431 (+ 1521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:27.224435 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:27.224438 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:27.224467 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:27.226181 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:27.226727 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:27.226731 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:27.226733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:27.226827 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:27.227156 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:27.227160 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:27.227162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:27.227363 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:27.227594 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:27.227753 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 02:28:27.227875 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":88,"threads_started":1}
I20260809 02:28:27.231698 11125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.217785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:54547 (local address 127.21.214.190:45647)
0809 02:28:27.217963 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:27.217968 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:27.219153 (+ 1185us) server_negotiation.cc:407] Connection header received
0809 02:28:27.221054 (+ 1901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:27.221057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:27.221103 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:27.221172 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:27.222545 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.223310 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.224574 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.224800 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.224923 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.227803 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:27.227807 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:27.227809 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:27.227844 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:27.229573 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:27.230257 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:27.230260 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:27.230261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:27.230334 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:27.230699 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:27.230701 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:27.230702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:27.230867 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:27.230943 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:27.231490 (+ 547us) server_negotiation.cc:299] Negotiation successful
0809 02:28:27.231588 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 02:28:27.232529 11511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.218340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:54547)
0809 02:28:27.218976 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:27.219034 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:27.220768 (+ 1734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:27.221390 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:27.221399 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:27.221862 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:27.222346 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:27.222360 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.223441 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.223448 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:27.224445 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:27.224456 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.224967 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.224971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:27.225177 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.225849 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:27.225866 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:27.227634 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:27.229690 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:27.229696 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:27.229707 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:27.230133 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:27.230457 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:27.230462 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:27.230469 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:27.230603 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:27.230959 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:27.230964 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:27.231252 (+ 288us) client_negotiation.cc:769] Sending connection context
0809 02:28:27.231406 (+ 154us) client_negotiation.cc:240] Negotiation successful
0809 02:28:27.231650 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":162,"threads_started":1}
I20260809 02:28:27.233652 11509 heartbeater.cc:347] Connected to a master server at 127.21.214.190:45647
I20260809 02:28:27.233880 11509 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:27.234328 11509 heartbeater.cc:511] Master 127.21.214.190:45647 requested a full tablet report, sending...
I20260809 02:28:27.235363 10867 ts_manager.cc:194] Registered new tserver with Master: 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257)
I20260809 02:28:27.235888 10867 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:54547
I20260809 02:28:27.241725 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:28:27.246148 11125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.242363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56482 (local address 127.21.214.190:45647)
0809 02:28:27.242531 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:27.242536 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:27.242723 (+ 187us) server_negotiation.cc:407] Connection header received
0809 02:28:27.242902 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:27.242905 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:27.243003 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:27.243142 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:28:27.243383 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.243876 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.244746 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.244975 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.245114 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.245439 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:28:27.245774 (+ 335us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:28:27.245903 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:27.245966 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 02:28:27.246015 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 02:28:27.246767 10867 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:56482:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:28:27.249943 10867 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:28:27.257989 11030 tablet_service.cc:1467] Processing CreateTablet for tablet ec84322b1cd5420c9d2a37fac4a0102b (DEFAULT_TABLE table=test-table [id=ca200ec1353b40d8a5b6370d25fdbaa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:28:27.258809 11030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec84322b1cd5420c9d2a37fac4a0102b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:27.262089 10977 tablet_bootstrap.cc:492] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7: Bootstrap starting.
I20260809 02:28:27.263188 10977 tablet_bootstrap.cc:654] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:27.263296 11130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.257130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:42735 (local address 127.0.0.1:35590)
0809 02:28:27.258038 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:27.258060 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:27.258147 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:27.258825 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:27.258831 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:27.258857 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:27.258942 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:27.258949 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.260359 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.260365 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:27.261435 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:27.261444 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.262684 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.262688 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:27.262840 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.262896 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 02:28:27.262987 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 02:28:27.263103 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"mutex_wait_us":40,"thread_start_us":116,"threads_started":1}
I20260809 02:28:27.263506 11521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.256839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:35257 (local address 127.0.0.1:53362)
0809 02:28:27.257602 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:27.257618 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:27.257734 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:27.258489 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:27.258492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:27.258512 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:27.258620 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:27.258626 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.260139 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.260143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:27.261572 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:27.261585 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.262893 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.262897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:27.262976 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.262993 (+ 17us) client_negotiation.cc:769] Sending connection context
0809 02:28:27.263124 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 02:28:27.263205 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":701,"mutex_wait_us":60}
I20260809 02:28:27.263952 11522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.257305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35590 (local address 127.21.214.130:42735)
0809 02:28:27.258276 (+ 971us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:27.258289 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:27.258314 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:28:27.258394 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:27.258401 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:27.258667 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:27.258837 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:27.259087 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.260228 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.261567 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.262547 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.262680 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.262806 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:27.263670 (+ 864us) server_negotiation.cc:299] Negotiation successful
0809 02:28:27.263797 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":804,"thread_start_us":140,"threads_started":1}
I20260809 02:28:27.264008 11523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.257454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53362 (local address 127.21.214.131:35257)
0809 02:28:27.257899 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:27.257911 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:27.257932 (+ 21us) server_negotiation.cc:407] Connection header received
0809 02:28:27.258007 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:27.258014 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:27.258293 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:27.258502 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:27.258838 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.259996 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.261709 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.262547 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.262679 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.262806 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:27.263617 (+ 811us) server_negotiation.cc:299] Negotiation successful
0809 02:28:27.263723 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":198,"threads_started":1}
I20260809 02:28:27.265923 10977 tablet_bootstrap.cc:492] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7: No bootstrap required, opened a new log
I20260809 02:28:27.266036 10977 ts_tablet_manager.cc:1397] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 02:28:27.266542 10977 raft_consensus.cc:348] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:27.266678 10977 raft_consensus.cc:374] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:27.267056 10977 raft_consensus.cc:729] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eb286de36c241ebaaa23c397c5f66c7, State: Initialized, Role: FOLLOWER
I20260809 02:28:27.267242 10977 consensus_queue.cc:260] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:27.267336 11224 tablet_service.cc:1467] Processing CreateTablet for tablet ec84322b1cd5420c9d2a37fac4a0102b (DEFAULT_TABLE table=test-table [id=ca200ec1353b40d8a5b6370d25fdbaa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:28:27.267333 11412 tablet_service.cc:1467] Processing CreateTablet for tablet ec84322b1cd5420c9d2a37fac4a0102b (DEFAULT_TABLE table=test-table [id=ca200ec1353b40d8a5b6370d25fdbaa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:28:27.268013 10977 ts_tablet_manager.cc:1428] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 02:28:27.268575 11224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec84322b1cd5420c9d2a37fac4a0102b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:27.268602 11412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec84322b1cd5420c9d2a37fac4a0102b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260809 02:28:27.271848 11123 tablet.cc:2369] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:28:27.277793 11525 tablet_bootstrap.cc:492] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36: Bootstrap starting.
I20260809 02:28:27.277793 11527 tablet_bootstrap.cc:492] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477: Bootstrap starting.
I20260809 02:28:27.280907 11525 tablet_bootstrap.cc:654] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:27.280911 11527 tablet_bootstrap.cc:654] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:27.281857 11525 log.cc:824] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:27.281857 11527 log.cc:824] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:27.283773 11525 tablet_bootstrap.cc:492] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36: No bootstrap required, opened a new log
I20260809 02:28:27.283799 11527 tablet_bootstrap.cc:492] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477: No bootstrap required, opened a new log
I20260809 02:28:27.284027 11527 ts_tablet_manager.cc:1397] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:28:27.284009 11525 ts_tablet_manager.cc:1397] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:28:27.287147 11525 raft_consensus.cc:348] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:27.287148 11527 raft_consensus.cc:348] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:27.287381 11525 raft_consensus.cc:374] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:27.287375 11527 raft_consensus.cc:374] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:27.287441 11525 raft_consensus.cc:729] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146b9bf425704a87aab9ccc16f1f4e36, State: Initialized, Role: FOLLOWER
I20260809 02:28:27.287446 11527 raft_consensus.cc:729] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19e5adfc4e3e4b0785b031462de47477, State: Initialized, Role: FOLLOWER
I20260809 02:28:27.287889 11525 consensus_queue.cc:260] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:27.288038 11527 consensus_queue.cc:260] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:27.288743 11307 heartbeater.cc:503] Master 127.21.214.190:45647 was elected leader, sending a full tablet report...
I20260809 02:28:27.288873 11525 ts_tablet_manager.cc:1428] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:28:27.288981 11527 ts_tablet_manager.cc:1428] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260809 02:28:27.289191 11509 heartbeater.cc:503] Master 127.21.214.190:45647 was elected leader, sending a full tablet report...
I20260809 02:28:27.389456 11532 raft_consensus.cc:482] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:28:27.389703 11532 raft_consensus.cc:504] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:27.390998 11532 leader_election.cc:288] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257), 8eb286de36c241ebaaa23c397c5f66c7 (127.21.214.129:33519)
I20260809 02:28:27.396528 11523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.391529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:35711 (local address 127.21.214.131:35257)
0809 02:28:27.391692 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:27.391697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:27.392022 (+ 325us) server_negotiation.cc:407] Connection header received
0809 02:28:27.392108 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:27.392111 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:27.392156 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:27.392230 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:27.392545 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.393304 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.395110 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.395732 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.395878 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.395936 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:27.396313 (+ 377us) server_negotiation.cc:299] Negotiation successful
0809 02:28:27.396392 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:28:27.396531 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.391414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:42273 (local address 127.21.214.129:33519)
0809 02:28:27.391789 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:27.391794 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:27.391810 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:28:27.391870 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:27.391873 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:27.391940 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:27.392073 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:27.392408 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.393279 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.395110 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.395786 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.395893 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.396038 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:27.396313 (+ 275us) server_negotiation.cc:299] Negotiation successful
0809 02:28:27.396392 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":141,"threads_started":1}
I20260809 02:28:27.396535 11310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.391286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:33519 (local address 127.21.214.130:42273)
0809 02:28:27.391396 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:27.391411 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:27.391511 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:27.392113 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:27.392116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:27.392131 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:27.392283 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:27.392290 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.393426 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.393430 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:27.394961 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:27.394973 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.395887 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.395889 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:27.396109 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.396184 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 02:28:27.396266 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 02:28:27.396359 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":186}
I20260809 02:28:27.396544 11534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.391290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:35257 (local address 127.21.214.130:35711)
0809 02:28:27.391910 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:27.391921 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:27.392014 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:27.392268 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:27.392271 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:27.392285 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:27.392428 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:27.392434 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.393426 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.393430 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:27.394965 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:27.394973 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.395883 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.395887 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:27.396129 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.396190 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 02:28:27.396266 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 02:28:27.396359 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"mutex_wait_us":576,"thread_start_us":131,"threads_started":1}
I20260809 02:28:27.397193 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec84322b1cd5420c9d2a37fac4a0102b" candidate_uuid: "19e5adfc4e3e4b0785b031462de47477" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eb286de36c241ebaaa23c397c5f66c7" is_pre_election: true
I20260809 02:28:27.397270 11439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec84322b1cd5420c9d2a37fac4a0102b" candidate_uuid: "19e5adfc4e3e4b0785b031462de47477" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146b9bf425704a87aab9ccc16f1f4e36" is_pre_election: true
I20260809 02:28:27.397535 11053 raft_consensus.cc:2454] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19e5adfc4e3e4b0785b031462de47477 in term 0.
I20260809 02:28:27.397600 11439 raft_consensus.cc:2454] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19e5adfc4e3e4b0785b031462de47477 in term 0.
I20260809 02:28:27.398057 11156 leader_election.cc:302] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 146b9bf425704a87aab9ccc16f1f4e36, 19e5adfc4e3e4b0785b031462de47477, 8eb286de36c241ebaaa23c397c5f66c7; no voters:
I20260809 02:28:27.398360 11532 raft_consensus.cc:2781] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:28:27.398458 11532 raft_consensus.cc:482] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:28:27.398545 11532 raft_consensus.cc:3037] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:27.399644 11532 raft_consensus.cc:504] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:27.400010 11532 leader_election.cc:288] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [CANDIDATE]: Term 1 election: Requested vote from peers 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257), 8eb286de36c241ebaaa23c397c5f66c7 (127.21.214.129:33519)
I20260809 02:28:27.400400 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec84322b1cd5420c9d2a37fac4a0102b" candidate_uuid: "19e5adfc4e3e4b0785b031462de47477" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8eb286de36c241ebaaa23c397c5f66c7"
I20260809 02:28:27.400429 11439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec84322b1cd5420c9d2a37fac4a0102b" candidate_uuid: "19e5adfc4e3e4b0785b031462de47477" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146b9bf425704a87aab9ccc16f1f4e36"
I20260809 02:28:27.400545 11053 raft_consensus.cc:3037] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:27.400545 11439 raft_consensus.cc:3037] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:27.401818 11053 raft_consensus.cc:2454] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19e5adfc4e3e4b0785b031462de47477 in term 1.
I20260809 02:28:27.401818 11439 raft_consensus.cc:2454] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19e5adfc4e3e4b0785b031462de47477 in term 1.
I20260809 02:28:27.402128 11155 leader_election.cc:302] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146b9bf425704a87aab9ccc16f1f4e36, 19e5adfc4e3e4b0785b031462de47477; no voters:
I20260809 02:28:27.402328 11532 raft_consensus.cc:2781] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:28:27.402585 11532 raft_consensus.cc:686] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [term 1 LEADER]: Becoming Leader. State: Replica: 19e5adfc4e3e4b0785b031462de47477, State: Running, Role: LEADER
I20260809 02:28:27.402937 11532 consensus_queue.cc:237] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:27.406268 10866 catalog_manager.cc:5495] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130). New cstate: current_term: 1 leader_uuid: "19e5adfc4e3e4b0785b031462de47477" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } health_report { overall_health: UNKNOWN } } }
I20260809 02:28:27.416994 11522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.413388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35596 (local address 127.21.214.130:42735)
0809 02:28:27.413520 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:27.413525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:27.413539 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:28:27.413666 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:27.413669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:27.413729 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:27.413839 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:28:27.414076 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.414662 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.415493 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:27.415730 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:27.415839 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:27.416205 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:28:27.416595 (+ 390us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:28:27.416730 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:27.416793 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 02:28:27.416852 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:28:27.423110 11053 raft_consensus.cc:1261] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Refusing update from remote peer 19e5adfc4e3e4b0785b031462de47477: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:28:27.423116 11439 raft_consensus.cc:1261] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36 [term 1 FOLLOWER]: Refusing update from remote peer 19e5adfc4e3e4b0785b031462de47477: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:28:27.423804 11532 consensus_queue.cc:1035] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [LEADER]: Connected to new peer: Peer: permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:28:27.423983 11536 consensus_queue.cc:1035] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:28:27.429668 11539 mvcc.cc:205] Tried to move back new op lower bound from 7316449310397812736 to 7316449310325129216. Current Snapshot: MvccSnapshot[applied={T|T < 7316449310397812736}]
I20260809 02:28:27.431286 11541 mvcc.cc:205] Tried to move back new op lower bound from 7316449310397812736 to 7316449310325129216. Current Snapshot: MvccSnapshot[applied={T|T < 7316449310397812736}]
I20260809 02:28:27.438599 10867 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:56482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:28:27.438773 10867 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:56482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:28:27.441200 10867 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Sending DeleteTablet for 3 replicas of tablet ec84322b1cd5420c9d2a37fac4a0102b
I20260809 02:28:27.441885 11030 tablet_service.cc:1514] Processing DeleteTablet for tablet ec84322b1cd5420c9d2a37fac4a0102b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:27 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:43506
I20260809 02:28:27.441934 11412 tablet_service.cc:1514] Processing DeleteTablet for tablet ec84322b1cd5420c9d2a37fac4a0102b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:27 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:53362
I20260809 02:28:27.442118 11224 tablet_service.cc:1514] Processing DeleteTablet for tablet ec84322b1cd5420c9d2a37fac4a0102b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:27 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:35590
I20260809 02:28:27.442397 11556 tablet_replica.cc:330] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7: stopping tablet replica
I20260809 02:28:27.442595 11556 raft_consensus.cc:2229] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:28:27.442610 11559 tablet_replica.cc:330] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477: stopping tablet replica
I20260809 02:28:27.442821 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 10915
I20260809 02:28:27.442826 11556 raft_consensus.cc:2258] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:28:27.445164 11559 raft_consensus.cc:2229] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:28:27.445469 11559 raft_consensus.cc:2258] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:28:27.448737 11559 ts_tablet_manager.cc:1905] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:28:27.451349 11559 ts_tablet_manager.cc:1918] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:28:27.451445 11559 log.cc:1196] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/ec84322b1cd5420c9d2a37fac4a0102b
I20260809 02:28:27.451745 11559 ts_tablet_manager.cc:1939] T ec84322b1cd5420c9d2a37fac4a0102b P 19e5adfc4e3e4b0785b031462de47477: Deleting consensus metadata
I20260809 02:28:27.453622 10850 catalog_manager.cc:4841] TS 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130:42735): tablet ec84322b1cd5420c9d2a37fac4a0102b (table test-table [id=ca200ec1353b40d8a5b6370d25fdbaa5]) successfully deleted
I20260809 02:28:27.455192 11558 tablet_replica.cc:330] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36: stopping tablet replica
I20260809 02:28:27.455590 11558 raft_consensus.cc:2229] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:28:27.455972 11558 raft_consensus.cc:2258] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:28:27.457888 11558 ts_tablet_manager.cc:1905] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:28:27.461427 11558 ts_tablet_manager.cc:1918] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:28:27.461539 11558 log.cc:1196] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/ec84322b1cd5420c9d2a37fac4a0102b
I20260809 02:28:27.461900 11558 ts_tablet_manager.cc:1939] T ec84322b1cd5420c9d2a37fac4a0102b P 146b9bf425704a87aab9ccc16f1f4e36: Deleting consensus metadata
W20260809 02:28:27.463194 10852 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:33519 (error 108)
I20260809 02:28:27.463330 10850 catalog_manager.cc:4841] TS 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257): tablet ec84322b1cd5420c9d2a37fac4a0102b (table test-table [id=ca200ec1353b40d8a5b6370d25fdbaa5]) successfully deleted
I20260809 02:28:27.463852 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 11126
I20260809 02:28:27.469455 11521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:27.469112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:33519 (local address 127.0.0.1:43512)
0809 02:28:27.469257 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:27.469345 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:33519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 02:28:27.469630 10852 catalog_manager.cc:4584] TS 8eb286de36c241ebaaa23c397c5f66c7 (127.21.214.129:33519): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ec84322b1cd5420c9d2a37fac4a0102b: Network error: Client connection negotiation failed: client connection to 127.21.214.129:33519: connect: Connection refused (error 111)
I20260809 02:28:27.477919 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 11313
I20260809 02:28:27.497215 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 10817
I20260809 02:28:27.509519 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:45647
--webserver_interface=127.21.214.190
--webserver_port=46489
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:43643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:45647
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:27.622397 11563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:27.622720 11563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:27.622793 11563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:27.626784 11563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:28:27.626842 11563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:27.626861 11563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:27.626902 11563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:28:27.626932 11563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:28:27.632129 11563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:45647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:45647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=46489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:27.633137 11563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:27.634147 11563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:27.642711 11571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:27.642740 11573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:27.642829 11563 server_base.cc:1034] running on GCE node
W20260809 02:28:27.642740 11576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:27.643544 11563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:27.644640 11563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:27.645838 11563 hybrid_clock.cc:648] HybridClock initialized: now 1786242507645808 us; error 47 us; skew 500 ppm
Aug 09 02:28:27 dist-test-slave-68xk krb5kdc[10048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242507, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:27.648690 11563 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:28:27.649569 11563 webserver.cc:460] Webserver started at http://127.21.214.190:46489/ using document root <none> and password file <none>
I20260809 02:28:27.650123 11563 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:27.650218 11563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:27.653990 11563 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260809 02:28:27.656426 11588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:27.657580 11563 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:28:27.657722 11563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "73fe5b6cd6834949855d08535df89ccc"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "aa10dabaeef311eb69e95610d6e64869"
server_key_iv: "5c125ad406d0033e1f7888574b3ece10"
server_key_version: "encryptionkey@0"
I20260809 02:28:27.658244 11563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:27.673508 11563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:27.676717 11563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:27.676925 11563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:27.684319 11563 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:45647
I20260809 02:28:27.684644 11666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:45647 every 8 connection(s)
I20260809 02:28:27.685456 11563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:28:27.686206 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 11563
I20260809 02:28:27.686779 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:33519
--local_ip_for_outbound_sockets=127.21.214.129
--tserver_master_addrs=127.21.214.190:45647
--webserver_port=43217
--webserver_interface=127.21.214.129
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:43643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:28:27.691170 11667 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:28:27.693291 11667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Bootstrap starting.
I20260809 02:28:27.711592 11667 log.cc:824] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:27.722998 11667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:28:27.723399 11667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc: Bootstrap complete.
I20260809 02:28:27.727598 11667 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } }
I20260809 02:28:27.728016 11667 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73fe5b6cd6834949855d08535df89ccc, State: Initialized, Role: FOLLOWER
I20260809 02:28:27.728597 11667 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } }
I20260809 02:28:27.728753 11667 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:28:27.728848 11667 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:28:27.728971 11667 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 2 FOLLOWER]: Advancing to term 3
I20260809 02:28:27.730988 11667 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } }
I20260809 02:28:27.731333 11667 leader_election.cc:302] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73fe5b6cd6834949855d08535df89ccc; no voters:
I20260809 02:28:27.731731 11667 leader_election.cc:288] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 02:28:27.731820 11673 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 3 FOLLOWER]: Leader election won for term 3
I20260809 02:28:27.732017 11673 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [term 3 LEADER]: Becoming Leader. State: Replica: 73fe5b6cd6834949855d08535df89ccc, State: Running, Role: LEADER
I20260809 02:28:27.732314 11673 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } }
I20260809 02:28:27.733057 11667 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:28:27.733295 11673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73fe5b6cd6834949855d08535df89ccc. Latest consensus state: current_term: 3 leader_uuid: "73fe5b6cd6834949855d08535df89ccc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } } }
I20260809 02:28:27.733403 11673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:27.733784 11677 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:28:27.733827 11674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "73fe5b6cd6834949855d08535df89ccc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73fe5b6cd6834949855d08535df89ccc" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45647 } } }
I20260809 02:28:27.734053 11674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73fe5b6cd6834949855d08535df89ccc [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:27.739136 11677 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:28:27.739832 11677 catalog_manager.cc:1259] Loaded cluster ID: 6abc73f7b94f47ec84cec921656d6104
I20260809 02:28:27.739898 11677 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 02:28:27.741051 11677 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7efe6e8539ad google::LogMessage::Fail() at ??:0
@ 0x7efe6e85688a google::LogMessage::SendToLog() at ??:0
@ 0x7efe6e8534de google::LogMessage::Flush() at ??:0
@ 0x7efe6e854a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7efe79192fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7efe79193d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7efe79190579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7efe791d4640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7efe70aa53d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7efe70aa5c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7efe70aa73f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7efe70a96512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7efe720da6db start_thread at ??:0
@ 0x7efe6d35161f clone at ??:0
W20260809 02:28:27.831677 11671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:27.832057 11671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:27.832134 11671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:27.838457 11671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:27.838538 11671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:27.838640 11671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:28:27.847002 11671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:33519
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=43217
--tserver_master_addrs=127.21.214.190:45647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:27.848526 11671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:27.849922 11671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:27.862643 11727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:27.862692 11724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:27.862659 11725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:27.863592 11671 server_base.cc:1034] running on GCE node
I20260809 02:28:27.864210 11671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:27.865186 11671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:27.866452 11671 hybrid_clock.cc:648] HybridClock initialized: now 1786242507866383 us; error 49 us; skew 500 ppm
Aug 09 02:28:27 dist-test-slave-68xk krb5kdc[10048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242507, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:27.870712 11671 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:28:27.871959 11671 webserver.cc:460] Webserver started at http://127.21.214.129:43217/ using document root <none> and password file <none>
I20260809 02:28:27.872771 11671 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:27.872888 11671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:27.878825 11671 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 02:28:27.881989 11738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:27.883836 11671 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:28:27.883984 11671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "8eb286de36c241ebaaa23c397c5f66c7"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "ca01493635a6721a08a327ca0b069b20"
server_key_iv: "cfe2fb5f441f64cbc7aaac1b1cbc0030"
server_key_version: "encryptionkey@0"
I20260809 02:28:27.884763 11671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:27.915911 11671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:27.920202 11671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:27.920428 11671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:27.921267 11671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:27.922951 11749 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:28:27.927875 11671 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:28:27.927959 11671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260809 02:28:27.928036 11671 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:28:27.930506 11671 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:28:27.930572 11671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.003s sys 0.000s
I20260809 02:28:27.930945 11749 tablet_bootstrap.cc:492] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7: Bootstrap starting.
I20260809 02:28:27.942938 11671 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:33519
I20260809 02:28:27.943126 11906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:33519 every 8 connection(s)
I20260809 02:28:27.944432 11671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:28:27.946178 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 11671
I20260809 02:28:27.946743 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:42735
--local_ip_for_outbound_sockets=127.21.214.130
--tserver_master_addrs=127.21.214.190:45647
--webserver_port=34825
--webserver_interface=127.21.214.130
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:43643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:28:27.956580 11749 log.cc:824] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:27.964394 11749 tablet_bootstrap.cc:492] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:28:27.964821 11749 tablet_bootstrap.cc:492] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7: Bootstrap complete.
I20260809 02:28:27.966202 11749 ts_tablet_manager.cc:1397] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7: Time spent bootstrapping tablet: real 0.036s user 0.031s sys 0.000s
I20260809 02:28:27.968887 11749 raft_consensus.cc:348] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:27.969352 11749 raft_consensus.cc:729] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8eb286de36c241ebaaa23c397c5f66c7, State: Initialized, Role: FOLLOWER
I20260809 02:28:27.969870 11749 consensus_queue.cc:260] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:27.970922 11749 ts_tablet_manager.cc:1428] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7: Time spent starting tablet: real 0.005s user 0.004s sys 0.004s
W20260809 02:28:28.027940 11909 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:28:27.946990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:49193)
0809 02:28:27.948333 (+ 1343us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:27.948399 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:27.949758 (+ 1359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:28.027153 (+ 77395us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1062,"thread_start_us":177,"threads_started":1}
W20260809 02:28:28.028579 11907 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:45647 (0 consecutive failures): Network error: Failed to ping master at 127.21.214.190:45647: Client connection negotiation failed: client connection to 127.21.214.190:45647: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:28:28.029426 11909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:28.029151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:48003)
0809 02:28:28.029303 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:28.029368 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 02:28:28.030085 11909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:28.029877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:59923)
0809 02:28:28.029986 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:28.030036 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 02:28:28.030260 11907 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:28:28.097083 11911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:28.097395 11911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:28.097481 11911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:28.101926 11911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:28.102018 11911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:28.102116 11911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:28:28.107858 11911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:42735
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=34825
--tserver_master_addrs=127.21.214.190:45647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:28.108948 11911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:28.110030 11911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:28.120416 11920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:28.120462 11921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:28.120465 11924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:28.120507 11911 server_base.cc:1034] running on GCE node
I20260809 02:28:28.121158 11911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:28.121870 11911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:28.123040 11911 hybrid_clock.cc:648] HybridClock initialized: now 1786242508123021 us; error 31 us; skew 500 ppm
Aug 09 02:28:28 dist-test-slave-68xk krb5kdc[10048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242508, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:28.126044 11911 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:28:28.127019 11911 webserver.cc:460] Webserver started at http://127.21.214.130:34825/ using document root <none> and password file <none>
I20260809 02:28:28.127560 11911 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:28.127624 11911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:28.131590 11911 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:28:28.133720 11938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:28.135155 11911 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:28:28.135296 11911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "19e5adfc4e3e4b0785b031462de47477"
format_stamp: "Formatted at 2026-08-09 02:28:25 on dist-test-slave-68xk"
server_key: "8c600b7ed4f016d7d88314b8ce179c89"
server_key_iv: "dc8be081e24d7070598904382ec8f731"
server_key_version: "encryptionkey@0"
I20260809 02:28:28.135896 11911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:28.156100 11911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:28.159710 11911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:28.159942 11911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:28.160593 11911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:28.161403 11911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:28.161453 11911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:28.161495 11911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:28.161513 11911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:28.171680 11911 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:42735
I20260809 02:28:28.171703 12101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:42735 every 8 connection(s)
I20260809 02:28:28.172722 11911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:28:28.176637 12106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:28.174886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:55577)
0809 02:28:28.175365 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:28.175831 (+ 466us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":113,"threads_started":1}
W20260809 02:28:28.177083 12103 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:45647 (0 consecutive failures): Network error: Failed to ping master at 127.21.214.190:45647: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
I20260809 02:28:28.177805 12106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:28.177500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:41665)
0809 02:28:28.177681 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:28.177739 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260809 02:28:28.178481 12106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:28.178195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:39909)
0809 02:28:28.178316 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:28.178366 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 02:28:28.178689 12103 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:28:28.180768 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 11911
I20260809 02:28:28.181301 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:35257
--local_ip_for_outbound_sockets=127.21.214.131
--tserver_master_addrs=127.21.214.190:45647
--webserver_port=42977
--webserver_interface=127.21.214.131
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:43643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:28.295938 12107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:28.296200 12107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:28.296244 12107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:28.300606 12107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:28.300669 12107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:28.300753 12107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:28:28.306067 12107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:43643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:35257
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=42977
--tserver_master_addrs=127.21.214.190:45647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:28.307163 12107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:28.308267 12107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:28.317864 12114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:28.317905 12120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:28.317921 12115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:28.318037 12107 server_base.cc:1034] running on GCE node
I20260809 02:28:28.318729 12107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:28.319376 12107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:28.320566 12107 hybrid_clock.cc:648] HybridClock initialized: now 1786242508320542 us; error 61 us; skew 500 ppm
Aug 09 02:28:28 dist-test-slave-68xk krb5kdc[10048](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242508, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:28.323539 12107 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:28:28.324424 12107 webserver.cc:460] Webserver started at http://127.21.214.131:42977/ using document root <none> and password file <none>
I20260809 02:28:28.325002 12107 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:28.325114 12107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:28.329085 12107 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:28:28.331315 12129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:28.332527 12107 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:28:28.332664 12107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "146b9bf425704a87aab9ccc16f1f4e36"
format_stamp: "Formatted at 2026-08-09 02:28:26 on dist-test-slave-68xk"
server_key: "ad63161ca4469e39f46b2f4024445b7b"
server_key_iv: "a9c7fc405d0d12526ccb013ef57d681a"
server_key_version: "encryptionkey@0"
I20260809 02:28:28.333204 12107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:28.346136 12107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:28.349080 12107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:28.349303 12107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:28.349882 12107 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:28.350740 12107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:28.350814 12107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:28.350888 12107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:28.350931 12107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:28.360522 12107 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:35257
I20260809 02:28:28.360554 12298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:35257 every 8 connection(s)
I20260809 02:28:28.361491 12107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:28:28.365268 12303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:28.363661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:59255)
0809 02:28:28.364125 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:28.364542 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":111,"threads_started":1}
W20260809 02:28:28.365727 12301 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:45647 (0 consecutive failures): Network error: Failed to ping master at 127.21.214.190:45647: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
I20260809 02:28:28.366321 12303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:28.366095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:60155)
0809 02:28:28.366223 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:28.366270 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 02:28:28.366901 12303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:28.366725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:46939)
0809 02:28:28.366818 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:28.366857 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 02:28:28.367081 12301 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:28:28.369136 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 12107
I20260809 02:28:29.031394 12305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:29.030943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:44725)
0809 02:28:29.031213 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:29.031274 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":76,"threads_started":1}
I20260809 02:28:29.179713 12307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:29.179260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:52767)
0809 02:28:29.179535 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:29.179610 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":92,"threads_started":1}
I20260809 02:28:29.368028 12308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:29.367627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:47685)
0809 02:28:29.367879 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:29.367930 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":70,"threads_started":1}
I20260809 02:28:29.807237 12309 raft_consensus.cc:482] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:28:29.807538 12309 raft_consensus.cc:504] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:29.808782 12309 leader_election.cc:288] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257), 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130:42735)
Aug 09 02:28:29 dist-test-slave-68xk krb5kdc[10048](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242507, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.131@KRBTEST.COM
Aug 09 02:28:29 dist-test-slave-68xk krb5kdc[10048](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242507, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.130@KRBTEST.COM
I20260809 02:28:29.831085 12310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:29.809029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:35257 (local address 127.21.214.129:57739)
0809 02:28:29.809287 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:29.809301 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:29.809405 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:29.811662 (+ 2257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:29.811669 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:29.812307 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:29.813244 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:29.813252 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:29.815195 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:29.815199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:29.816835 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:29.816848 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:29.817843 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:29.817847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:29.818145 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:29.823746 (+ 5601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:29.823776 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:29.825761 (+ 1985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:29.828353 (+ 2592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:29.828361 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:29.828376 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:29.828751 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:29.829131 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:29.829134 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:29.829136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:29.829342 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:29.830035 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:29.830041 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:29.830266 (+ 225us) client_negotiation.cc:769] Sending connection context
0809 02:28:29.830478 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 02:28:29.830860 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":433,"spinlock_wait_cycles":18816,"thread_start_us":101,"threads_started":1}
I20260809 02:28:29.831101 12311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:29.809197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:57739 (local address 127.21.214.131:35257)
0809 02:28:29.809685 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:29.809709 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:29.809749 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:28:29.810749 (+ 1000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:29.810759 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:29.811215 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:29.811548 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:29.813423 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:29.815020 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:29.816965 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:29.817697 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:29.817872 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:29.826064 (+ 8192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:29.826073 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:29.826094 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:29.826130 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:29.828220 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:29.828871 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:29.828879 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:29.828889 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:29.829038 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:29.829466 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:29.829471 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:29.829476 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:29.829900 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:29.830044 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:29.830608 (+ 564us) server_negotiation.cc:299] Negotiation successful
0809 02:28:29.830900 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":101,"threads_started":1}
I20260809 02:28:29.831138 12312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:29.809440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:42735 (local address 127.21.214.129:39625)
0809 02:28:29.809764 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:29.809783 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:29.809893 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:29.811662 (+ 1769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:29.811669 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:29.812315 (+ 646us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:29.813219 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:29.813244 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:29.815195 (+ 1951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:29.815199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:29.816835 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:29.816848 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:29.817843 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:29.817847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:29.818147 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:29.823746 (+ 5599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:29.823770 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:29.826137 (+ 2367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:29.828695 (+ 2558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:29.828697 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:29.828699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:29.828993 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:29.829418 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:29.829423 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:29.829425 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:29.829524 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:29.830142 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:29.830145 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:29.830266 (+ 121us) client_negotiation.cc:769] Sending connection context
0809 02:28:29.830477 (+ 211us) client_negotiation.cc:240] Negotiation successful
0809 02:28:29.830952 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":535,"spinlock_wait_cycles":13440,"thread_start_us":60,"threads_started":1}
I20260809 02:28:29.831657 12313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:29.809649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:39625 (local address 127.21.214.130:42735)
0809 02:28:29.810001 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:29.810014 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:29.810050 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:28:29.810835 (+ 785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:29.810842 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:29.811214 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:29.811548 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:29.813423 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:29.815020 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:29.816965 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:29.817696 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:29.818154 (+ 458us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:29.826363 (+ 8209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:29.826367 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:29.826377 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:29.826407 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:29.828571 (+ 2164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:29.829131 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:29.829137 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:29.829142 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:29.829303 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:29.829610 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:29.829614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:29.829616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:29.830018 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:29.830156 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:29.830592 (+ 436us) server_negotiation.cc:299] Negotiation successful
0809 02:28:29.830941 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":136,"threads_started":1}
W20260809 02:28:29.833736 11740 leader_election.cc:341] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257): Not found: Tablet not found: ec84322b1cd5420c9d2a37fac4a0102b
W20260809 02:28:29.833968 11740 leader_election.cc:341] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130:42735): Not found: Tablet not found: ec84322b1cd5420c9d2a37fac4a0102b
I20260809 02:28:29.834048 11740 leader_election.cc:302] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8eb286de36c241ebaaa23c397c5f66c7; no voters: 146b9bf425704a87aab9ccc16f1f4e36, 19e5adfc4e3e4b0785b031462de47477
I20260809 02:28:29.834342 12309 raft_consensus.cc:2726] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:28:30.032619 12312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:30.032293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:42491)
0809 02:28:30.032458 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:30.032523 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 02:28:30.180982 12314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:30.180513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:53127)
0809 02:28:30.180811 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:30.180865 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":117,"threads_started":1}
I20260809 02:28:30.369215 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:30.368816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:57511)
0809 02:28:30.369076 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:30.369129 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":75,"threads_started":1}
I20260809 02:28:31.033878 12317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:31.033415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:56739)
0809 02:28:31.033710 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:31.033772 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":78,"threads_started":1}
I20260809 02:28:31.182281 12318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:31.181780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:45493)
0809 02:28:31.182073 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:31.182177 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":78,"threads_started":1}
I20260809 02:28:31.370538 12319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:31.369979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:58695)
0809 02:28:31.370266 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:31.370323 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":96,"threads_started":1}
I20260809 02:28:31.693310 12322 raft_consensus.cc:482] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:28:31.693485 12322 raft_consensus.cc:504] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:31.693944 12322 leader_election.cc:288] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257), 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130:42735)
W20260809 02:28:31.695009 11740 leader_election.cc:341] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257): Not found: Tablet not found: ec84322b1cd5420c9d2a37fac4a0102b
W20260809 02:28:31.695199 11740 leader_election.cc:341] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130:42735): Not found: Tablet not found: ec84322b1cd5420c9d2a37fac4a0102b
I20260809 02:28:31.695276 11740 leader_election.cc:302] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8eb286de36c241ebaaa23c397c5f66c7; no voters: 146b9bf425704a87aab9ccc16f1f4e36, 19e5adfc4e3e4b0785b031462de47477
I20260809 02:28:31.695508 12322 raft_consensus.cc:2726] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:28:32.035163 12324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:32.034742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:32879)
0809 02:28:32.035011 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:32.035063 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":84,"threads_started":1}
I20260809 02:28:32.183511 12325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:32.183080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:57533)
0809 02:28:32.183354 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:32.183404 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":102,"threads_started":1}
I20260809 02:28:32.371867 12327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:32.371419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:46523)
0809 02:28:32.371691 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:32.371769 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":86,"threads_started":1}
I20260809 02:28:33.036777 12328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:33.036214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:42419)
0809 02:28:33.036593 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:33.036668 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":101,"threads_started":1}
I20260809 02:28:33.184801 12329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:33.184326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:33283)
0809 02:28:33.184632 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:33.184696 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":98,"threads_started":1}
I20260809 02:28:33.373189 12330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:33.372726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:34213)
0809 02:28:33.373022 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:33.373088 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":102,"threads_started":1}
I20260809 02:28:34.038362 12331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:34.037768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:52475)
0809 02:28:34.038182 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:34.038255 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":150,"threads_started":1}
I20260809 02:28:34.186246 12333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:34.185770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:37161)
0809 02:28:34.186075 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:34.186144 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":77,"threads_started":1}
I20260809 02:28:34.374650 12334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:34.374148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:44001)
0809 02:28:34.374486 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:34.374551 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":85,"threads_started":1}
I20260809 02:28:35.039955 12335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:35.039410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:43897)
0809 02:28:35.039725 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:35.039827 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":104,"threads_started":1}
I20260809 02:28:35.066874 12336 raft_consensus.cc:482] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:28:35.067055 12336 raft_consensus.cc:504] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:35.067574 12336 leader_election.cc:288] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257), 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130:42735)
W20260809 02:28:35.068626 11740 leader_election.cc:341] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130:42735): Not found: Tablet not found: ec84322b1cd5420c9d2a37fac4a0102b
W20260809 02:28:35.068812 11740 leader_election.cc:341] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257): Not found: Tablet not found: ec84322b1cd5420c9d2a37fac4a0102b
I20260809 02:28:35.068882 11740 leader_election.cc:302] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8eb286de36c241ebaaa23c397c5f66c7; no voters: 146b9bf425704a87aab9ccc16f1f4e36, 19e5adfc4e3e4b0785b031462de47477
I20260809 02:28:35.069079 12336 raft_consensus.cc:2726] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:28:35.187844 12337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:35.187124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:51951)
0809 02:28:35.187479 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:35.187549 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":77,"threads_started":1}
I20260809 02:28:35.376165 12338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:35.375545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:36443)
0809 02:28:35.375964 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:35.376033 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":103,"threads_started":1}
I20260809 02:28:36.041215 12339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:36.040749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:59385)
0809 02:28:36.041055 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:36.041115 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":77,"threads_started":1}
I20260809 02:28:36.189262 12344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:36.188722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:43969)
0809 02:28:36.189062 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:36.189158 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":80,"threads_started":1}
I20260809 02:28:36.377424 12347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:36.376932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:58071)
0809 02:28:36.377256 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:36.377319 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":79,"threads_started":1}
I20260809 02:28:37.042611 12348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:37.042080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:53279)
0809 02:28:37.042364 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:37.042490 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":108,"threads_started":1}
I20260809 02:28:37.190775 12350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:37.190122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:44489)
0809 02:28:37.190592 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:37.190670 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":123,"threads_started":1}
I20260809 02:28:37.378794 12351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:37.378283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:45625)
0809 02:28:37.378642 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:37.378698 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":90,"threads_started":1}
I20260809 02:28:38.043926 12352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:38.043521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:44235)
0809 02:28:38.043769 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:38.043826 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":88,"threads_started":1}
I20260809 02:28:38.192173 12353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:38.191623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:34789)
0809 02:28:38.191966 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:38.192025 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":122,"threads_started":1}
I20260809 02:28:38.379956 12356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:38.379553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:55751)
0809 02:28:38.379813 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:38.379866 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":93,"threads_started":1}
I20260809 02:28:38.755224 12359 raft_consensus.cc:482] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:28:38.755364 12359 raft_consensus.cc:504] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146b9bf425704a87aab9ccc16f1f4e36" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 35257 } } peers { permanent_uuid: "19e5adfc4e3e4b0785b031462de47477" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 42735 } } peers { permanent_uuid: "8eb286de36c241ebaaa23c397c5f66c7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 33519 } }
I20260809 02:28:38.755725 12359 leader_election.cc:288] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257), 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130:42735)
W20260809 02:28:38.756594 11740 leader_election.cc:341] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19e5adfc4e3e4b0785b031462de47477 (127.21.214.130:42735): Not found: Tablet not found: ec84322b1cd5420c9d2a37fac4a0102b
W20260809 02:28:38.756789 11740 leader_election.cc:341] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 146b9bf425704a87aab9ccc16f1f4e36 (127.21.214.131:35257): Not found: Tablet not found: ec84322b1cd5420c9d2a37fac4a0102b
I20260809 02:28:38.756875 11740 leader_election.cc:302] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8eb286de36c241ebaaa23c397c5f66c7; no voters: 146b9bf425704a87aab9ccc16f1f4e36, 19e5adfc4e3e4b0785b031462de47477
I20260809 02:28:38.757021 12359 raft_consensus.cc:2726] T ec84322b1cd5420c9d2a37fac4a0102b P 8eb286de36c241ebaaa23c397c5f66c7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:28:39.045260 12361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:39.044779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:33511)
0809 02:28:39.045078 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:39.045147 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":83,"threads_started":1}
I20260809 02:28:39.193315 12362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:39.192911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:39615)
0809 02:28:39.193168 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:39.193220 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":101,"threads_started":1}
I20260809 02:28:39.381232 12363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:39.380781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:59775)
0809 02:28:39.381070 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:39.381145 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":94,"threads_started":1}
I20260809 02:28:40.046583 12364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:40.046139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:55145)
0809 02:28:40.046405 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:40.046483 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":82,"threads_started":1}
I20260809 02:28:40.194725 12365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:40.194080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:52711)
0809 02:28:40.194399 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:40.194619 (+ 220us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":101,"threads_started":1}
I20260809 02:28:40.382622 12366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:40.382132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:57045)
0809 02:28:40.382458 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:40.382524 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":96,"threads_started":1}
I20260809 02:28:41.047986 12368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:41.047393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:51743)
0809 02:28:41.047786 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:41.047849 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":109,"threads_started":1}
I20260809 02:28:41.196017 12369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:41.195540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:40673)
0809 02:28:41.195851 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:41.195913 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":116,"threads_started":1}
I20260809 02:28:41.383879 12371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:41.383445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:50671)
0809 02:28:41.383728 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:41.383783 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":121,"threads_started":1}
I20260809 02:28:42.049252 12372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:42.048821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:56269)
0809 02:28:42.049092 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:42.049149 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":84,"threads_started":1}
I20260809 02:28:42.197433 12373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:42.196910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:59607)
0809 02:28:42.197240 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:42.197315 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":88,"threads_started":1}
I20260809 02:28:42.385429 12376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:42.384821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:37519)
0809 02:28:42.385201 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:42.385326 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":129,"threads_started":1}
I20260809 02:28:43.050657 12378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:43.050201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.129:41809)
0809 02:28:43.050499 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:43.050555 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":101,"threads_started":1}
I20260809 02:28:43.198886 12379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:43.198457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.130:52205)
0809 02:28:43.198732 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:43.198787 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":73,"threads_started":1}
I20260809 02:28:43.372104 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 11671
I20260809 02:28:43.385807 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 11911
I20260809 02:28:43.390241 12381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:43.388316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45647 (local address 127.21.214.131:53989)
0809 02:28:43.390091 (+ 1775us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:43.390145 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:45647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1697,"thread_start_us":72,"threads_started":1}
I20260809 02:28:43.395242 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 12107
2026-08-09T02:28:43Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19631 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:28:43 dist-test-slave-68xk krb5kdc[12384](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:28:43 dist-test-slave-68xk krb5kdc[12384](info): set up 2 sockets
Aug 09 02:28:43 dist-test-slave-68xk krb5kdc[12384](info): commencing operation
krb5kdc: starting...
W20260809 02:28:44.629844 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.208s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:28:44 dist-test-slave-68xk krb5kdc[12384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:28:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:28:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:28:44.763867 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:36419
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:36419
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:44.878286 12404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:44.878626 12404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:44.878706 12404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:44.882685 12404 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 02:28:44.882754 12404 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 02:28:44.882779 12404 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 02:28:44.882817 12404 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:28:44.882853 12404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:44.882895 12404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:44.882931 12404 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:28:44.882966 12404 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:28:44.888217 12404 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:36419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:36419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:44.889288 12404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:44.890314 12404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:28:44.899279 12404 server_base.cc:1034] running on GCE node
W20260809 02:28:44.899291 12411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:44.899463 12414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:44.899343 12410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:44.900175 12404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:44.901216 12404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:44.902395 12404 hybrid_clock.cc:648] HybridClock initialized: now 1786242524902373 us; error 32 us; skew 500 ppm
Aug 09 02:28:44 dist-test-slave-68xk krb5kdc[12384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242524, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:44.905438 12404 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:28:44.906317 12404 webserver.cc:460] Webserver started at http://127.21.214.190:33289/ using document root <none> and password file <none>
I20260809 02:28:44.906900 12404 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:44.906965 12404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:44.907233 12404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:28:44.909333 12404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2"
format_stamp: "Formatted at 2026-08-09 02:28:44 on dist-test-slave-68xk"
server_key: "91e18bf36da4cbc6c9fd6bd9f15ad753"
server_key_iv: "65e8ec348146e9a5e39ce9c43db54397"
server_key_version: "encryptionkey@0"
I20260809 02:28:44.909905 12404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2"
format_stamp: "Formatted at 2026-08-09 02:28:44 on dist-test-slave-68xk"
server_key: "91e18bf36da4cbc6c9fd6bd9f15ad753"
server_key_iv: "65e8ec348146e9a5e39ce9c43db54397"
server_key_version: "encryptionkey@0"
I20260809 02:28:44.913744 12404 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 02:28:44.916811 12423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:44.918709 12404 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 02:28:44.918839 12404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2"
format_stamp: "Formatted at 2026-08-09 02:28:44 on dist-test-slave-68xk"
server_key: "91e18bf36da4cbc6c9fd6bd9f15ad753"
server_key_iv: "65e8ec348146e9a5e39ce9c43db54397"
server_key_version: "encryptionkey@0"
I20260809 02:28:44.918953 12404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:44.956897 12404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:44.960480 12404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:44.960654 12404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:44.968083 12404 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:36419
I20260809 02:28:44.968386 12499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:36419 every 8 connection(s)
I20260809 02:28:44.969135 12404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:28:44.971439 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 12404
I20260809 02:28:44.971563 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:28:44.971904 22362 external_mini_cluster.cc:1428] Setting key bbcba1d9478ee1ece3d741f3db70fd79
I20260809 02:28:44.972419 12502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:44.978612 12502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Bootstrap starting.
I20260809 02:28:44.980834 12502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:44.981585 12502 log.cc:824] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:44.983553 12502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: No bootstrap required, opened a new log
Aug 09 02:28:44 dist-test-slave-68xk krb5kdc[12384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:44.987176 12502 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } }
I20260809 02:28:44.987497 12502 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:44.987586 12502 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1c41ac87aa4dbeb2a0a2b3d72573d2, State: Initialized, Role: FOLLOWER
I20260809 02:28:44.988128 12502 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } }
I20260809 02:28:44.988328 12502 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:28:44.988404 12502 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:28:44.988502 12502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:44.989382 12502 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } }
I20260809 02:28:44.989732 12502 leader_election.cc:302] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac1c41ac87aa4dbeb2a0a2b3d72573d2; no voters:
I20260809 02:28:44.990052 12502 leader_election.cc:288] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:28:44.990206 12510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:28:44.990525 12510 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 1 LEADER]: Becoming Leader. State: Replica: ac1c41ac87aa4dbeb2a0a2b3d72573d2, State: Running, Role: LEADER
I20260809 02:28:44.990880 12510 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } }
I20260809 02:28:44.991468 12502 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:28:44.992803 12513 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac1c41ac87aa4dbeb2a0a2b3d72573d2. Latest consensus state: current_term: 1 leader_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } } }
I20260809 02:28:44.992960 12513 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:44.993149 12506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:44.973410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55480 (local address 127.21.214.190:36419)
0809 02:28:44.973859 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:44.973874 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:44.973910 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:28:44.974665 (+ 755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:44.974685 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:44.975012 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:44.975350 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:44.976179 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:44.977181 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:44.978064 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:44.978619 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:44.978814 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:44.986772 (+ 7958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:44.986778 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:44.986792 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:44.986822 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:44.989146 (+ 2324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:44.989654 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:44.989662 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:44.989673 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:44.989791 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:44.990153 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:44.990156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:44.990158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:44.990716 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:44.991580 (+ 864us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:44.991736 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 02:28:44.992056 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":139,"threads_started":1}
I20260809 02:28:44.993368 12525 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:28:44.992805 12512 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } } }
I20260809 02:28:44.993476 12512 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: This master's current role is: LEADER
I20260809 02:28:44.996564 12525 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:28:45.001761 12525 catalog_manager.cc:1347] Generated new cluster ID: 5d439ba8d27b47ddbb8537e16765c69a
I20260809 02:28:45.001829 12525 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:28:45.021584 12525 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:28:45.022739 12525 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:28:45.037537 12525 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Generated new TSK 0
I20260809 02:28:45.038252 12525 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:28:45.074136 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:36419
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:45.188129 12543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:45.188426 12543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:45.188503 12543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:45.192655 12543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:45.192734 12543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:45.192850 12543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:28:45.198233 12543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:36419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:45.199306 12543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:45.200343 12543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:45.210049 12551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:45.210016 12553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:45.210023 12550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:45.210361 12543 server_base.cc:1034] running on GCE node
I20260809 02:28:45.210806 12543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:45.211519 12543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:45.212723 12543 hybrid_clock.cc:648] HybridClock initialized: now 1786242525212711 us; error 25 us; skew 500 ppm
Aug 09 02:28:45 dist-test-slave-68xk krb5kdc[12384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242525, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:45.215662 12543 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:28:45.216565 12543 webserver.cc:460] Webserver started at http://127.21.214.129:35579/ using document root <none> and password file <none>
I20260809 02:28:45.217147 12543 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:45.217242 12543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:45.217487 12543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:28:45.219556 12543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "a160f83ae7eb48538c54f55bb3145c02"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "4aa8fe9af8fc2cb2548b7d34a76be604"
server_key_iv: "7ec23f597ff5195d82b8daceef661317"
server_key_version: "encryptionkey@0"
I20260809 02:28:45.220129 12543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "a160f83ae7eb48538c54f55bb3145c02"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "4aa8fe9af8fc2cb2548b7d34a76be604"
server_key_iv: "7ec23f597ff5195d82b8daceef661317"
server_key_version: "encryptionkey@0"
I20260809 02:28:45.224025 12543 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 02:28:45.226612 12563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:45.227824 12543 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:28:45.227963 12543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "a160f83ae7eb48538c54f55bb3145c02"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "4aa8fe9af8fc2cb2548b7d34a76be604"
server_key_iv: "7ec23f597ff5195d82b8daceef661317"
server_key_version: "encryptionkey@0"
I20260809 02:28:45.228077 12543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:45.242707 12543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:45.245824 12543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:45.246048 12543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:45.246742 12543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:45.247599 12543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:45.247675 12543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:45.247748 12543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:45.247802 12543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:45.257221 12543 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:36393
I20260809 02:28:45.257254 12726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:36393 every 8 connection(s)
I20260809 02:28:45.258131 12543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:28:45.261267 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 12543
I20260809 02:28:45.261409 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:28:45.261808 22362 external_mini_cluster.cc:1428] Setting key 6082d4b0d2d606987ea1571e8d41cc2e
Aug 09 02:28:45 dist-test-slave-68xk krb5kdc[12384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242525, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:45.275933 12506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:45.260079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:38731 (local address 127.21.214.190:36419)
0809 02:28:45.260227 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:45.260233 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:45.261168 (+ 935us) server_negotiation.cc:407] Connection header received
0809 02:28:45.262891 (+ 1723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:45.262894 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:45.262942 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:45.263032 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:45.264609 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.265154 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.266846 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.267264 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.267365 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:45.271128 (+ 3763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:45.271133 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:45.271137 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:45.271200 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:45.273231 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:45.273955 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:45.273960 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:45.273962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:45.274073 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:45.274571 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:45.274574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:45.274576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:45.274784 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:45.274901 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:45.275584 (+ 683us) server_negotiation.cc:299] Negotiation successful
0809 02:28:45.275740 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:28:45.276974 12732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:45.260447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:38731)
0809 02:28:45.260924 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:45.261027 (+ 103us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:45.262682 (+ 1655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:45.263205 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:45.263232 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:45.263701 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:45.264435 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:45.264460 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.265297 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.265304 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:45.266676 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:45.266690 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.267597 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.267601 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:45.267854 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:45.268562 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:45.268584 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:45.270912 (+ 2328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:45.273397 (+ 2485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:45.273405 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:45.273424 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:45.273816 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:45.274195 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:45.274199 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:45.274201 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:45.274462 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:45.274902 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:45.274910 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:45.275286 (+ 376us) client_negotiation.cc:769] Sending connection context
0809 02:28:45.275526 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 02:28:45.275888 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":119,"threads_started":1}
I20260809 02:28:45.278599 12728 heartbeater.cc:347] Connected to a master server at 127.21.214.190:36419
I20260809 02:28:45.278903 12728 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
I20260809 02:28:45.279491 12728 heartbeater.cc:511] Master 127.21.214.190:36419 requested a full tablet report, sending...
I20260809 02:28:45.281296 12451 ts_manager.cc:194] Registered new tserver with Master: a160f83ae7eb48538c54f55bb3145c02 (127.21.214.129:36393)
I20260809 02:28:45.283001 12451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:38731
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:28:45.300051 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:36419
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:45.424104 12735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:45.424372 12735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:45.424414 12735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:45.428297 12735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:45.428350 12735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:45.428406 12735 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:28:45.433761 12735 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:36419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:45.434813 12735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:45.435783 12735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:45.445576 12746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:45.445590 12750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:45.445597 12747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:45.446219 12735 server_base.cc:1034] running on GCE node
I20260809 02:28:45.446755 12735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:45.447394 12735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:45.448632 12735 hybrid_clock.cc:648] HybridClock initialized: now 1786242525448577 us; error 53 us; skew 500 ppm
Aug 09 02:28:45 dist-test-slave-68xk krb5kdc[12384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242525, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:45.451773 12735 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:28:45.452762 12735 webserver.cc:460] Webserver started at http://127.21.214.130:38253/ using document root <none> and password file <none>
I20260809 02:28:45.453353 12735 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:45.453455 12735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:45.453703 12735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:28:45.455847 12735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "0df857ef80004a2398112b70d2256e37"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "2d77e990d714f43042117e07566ea897"
server_key_iv: "76576e14e343fc165ca0cc0246ba31c8"
server_key_version: "encryptionkey@0"
I20260809 02:28:45.456429 12735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "0df857ef80004a2398112b70d2256e37"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "2d77e990d714f43042117e07566ea897"
server_key_iv: "76576e14e343fc165ca0cc0246ba31c8"
server_key_version: "encryptionkey@0"
I20260809 02:28:45.460263 12735 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:28:45.462841 12762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:45.464124 12735 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:28:45.464277 12735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "0df857ef80004a2398112b70d2256e37"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "2d77e990d714f43042117e07566ea897"
server_key_iv: "76576e14e343fc165ca0cc0246ba31c8"
server_key_version: "encryptionkey@0"
I20260809 02:28:45.464396 12735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:45.480715 12735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:45.483570 12735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:45.483773 12735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:45.484349 12735 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:45.485196 12735 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:45.485270 12735 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:45.485342 12735 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:45.485387 12735 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:45.495589 12735 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:35265
I20260809 02:28:45.495638 12942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:35265 every 8 connection(s)
I20260809 02:28:45.496492 12735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:28:45.498581 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 12735
I20260809 02:28:45.498704 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:28:45.499145 22362 external_mini_cluster.cc:1428] Setting key 075dc3bafd3ede1a683b542d7c4482bd
Aug 09 02:28:45 dist-test-slave-68xk krb5kdc[12384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242525, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
I20260809 02:28:45.512387 12506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:45.498260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:33007 (local address 127.21.214.190:36419)
0809 02:28:45.498465 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:45.498471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:45.499408 (+ 937us) server_negotiation.cc:407] Connection header received
0809 02:28:45.500884 (+ 1476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:45.500887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:45.500945 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:45.501044 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:45.502148 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.502995 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.504693 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.505126 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.505243 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:45.508244 (+ 3001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:45.508252 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:45.508259 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:45.508296 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:45.510135 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:45.510809 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:45.510815 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:45.510817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:45.510910 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:45.511376 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:45.511382 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:45.511385 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:45.511609 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:45.511693 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:45.512160 (+ 467us) server_negotiation.cc:299] Negotiation successful
0809 02:28:45.512263 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 02:28:45.513320 12946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:45.498652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:33007)
0809 02:28:45.499239 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:45.499292 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:45.500684 (+ 1392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:45.501179 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:45.501185 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:45.501534 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:45.502006 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:45.502019 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.503129 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.503133 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:45.504563 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:45.504574 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.505280 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.505282 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:45.505432 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:45.506103 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:45.506127 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:45.508061 (+ 1934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:45.510275 (+ 2214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:45.510280 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:45.510293 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:45.510691 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:45.511033 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:45.511035 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:45.511037 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:45.511253 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:45.511710 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:45.511715 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:45.511939 (+ 224us) client_negotiation.cc:769] Sending connection context
0809 02:28:45.512098 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 02:28:45.512350 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":151,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
I20260809 02:28:45.514599 12943 heartbeater.cc:347] Connected to a master server at 127.21.214.190:36419
I20260809 02:28:45.514863 12943 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:45.515379 12943 heartbeater.cc:511] Master 127.21.214.190:36419 requested a full tablet report, sending...
I20260809 02:28:45.516618 12451 ts_manager.cc:194] Registered new tserver with Master: 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265)
I20260809 02:28:45.517596 12451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:33007
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:28:45.533433 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:36419
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:28:45.647460 12951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:28:45.647722 12951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:28:45.647766 12951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:28:45.651759 12951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:28:45.651819 12951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:28:45.651904 12951 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:28:45.657267 12951 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:36419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12951
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:28:45.658340 12951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:28:45.659387 12951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:28:45.669509 12956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:28:45.669515 12957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:45.669749 12951 server_base.cc:1034] running on GCE node
W20260809 02:28:45.669517 12961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:28:45.670228 12951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:28:45.670974 12951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:28:45.672163 12951 hybrid_clock.cc:648] HybridClock initialized: now 1786242525672135 us; error 45 us; skew 500 ppm
Aug 09 02:28:45 dist-test-slave-68xk krb5kdc[12384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242525, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:28:45.675073 12951 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:28:45.675928 12951 webserver.cc:460] Webserver started at http://127.21.214.131:40311/ using document root <none> and password file <none>
I20260809 02:28:45.676501 12951 fs_manager.cc:359] Metadata directory not provided
I20260809 02:28:45.676599 12951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:28:45.676848 12951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:28:45.678985 12951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "bb65ade627674f05b00c95a4d3531c4c"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "f59cc2d23fa274f039e65eff74505239"
server_key_iv: "686cd431aabac29fb91a717377d5bc93"
server_key_version: "encryptionkey@0"
I20260809 02:28:45.679565 12951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "bb65ade627674f05b00c95a4d3531c4c"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "f59cc2d23fa274f039e65eff74505239"
server_key_iv: "686cd431aabac29fb91a717377d5bc93"
server_key_version: "encryptionkey@0"
I20260809 02:28:45.683509 12951 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 02:28:45.686302 12970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:45.687701 12951 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:28:45.687876 12951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "bb65ade627674f05b00c95a4d3531c4c"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "f59cc2d23fa274f039e65eff74505239"
server_key_iv: "686cd431aabac29fb91a717377d5bc93"
server_key_version: "encryptionkey@0"
I20260809 02:28:45.688006 12951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:28:45.706632 12951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:28:45.710242 12951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:28:45.710531 12951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:28:45.711182 12951 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:28:45.712086 12951 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:28:45.712167 12951 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:45.712247 12951 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:28:45.712297 12951 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:28:45.722136 12951 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:40589
I20260809 02:28:45.722204 13125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:40589 every 8 connection(s)
I20260809 02:28:45.723204 12951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:28:45.730738 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 12951
I20260809 02:28:45.730886 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:28:45.731190 22362 external_mini_cluster.cc:1428] Setting key dfb6e8f815885eda13cc74d55e7a7813
Aug 09 02:28:45 dist-test-slave-68xk krb5kdc[12384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242525, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:28:45.739115 12506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:45.725148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:50909 (local address 127.21.214.190:36419)
0809 02:28:45.725312 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:45.725316 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:45.726267 (+ 951us) server_negotiation.cc:407] Connection header received
0809 02:28:45.727635 (+ 1368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:45.727639 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:45.727703 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:45.727787 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:45.728978 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.729520 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.730891 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.731224 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.731374 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:45.734444 (+ 3070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:45.734448 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:45.734450 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:45.734476 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:45.736659 (+ 2183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:45.737384 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:45.737389 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:45.737391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:45.737489 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:45.737872 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:45.737877 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:45.737879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:45.738086 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:45.738206 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:45.738884 (+ 678us) server_negotiation.cc:299] Negotiation successful
0809 02:28:45.738995 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:28:45.740095 13128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:45.725563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:50909)
0809 02:28:45.726087 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:45.726147 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:45.727415 (+ 1268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:45.727967 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:45.727974 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:45.728340 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:28:45.728821 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:45.728834 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.729651 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.729655 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:45.730736 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:45.730749 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.731433 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.731438 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:45.731654 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:45.732471 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:28:45.732493 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:28:45.734229 (+ 1736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:28:45.736836 (+ 2607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:45.736843 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:45.736859 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:45.737261 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:45.737594 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:28:45.737598 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:28:45.737601 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:28:45.737761 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:28:45.738223 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:28:45.738232 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:28:45.738592 (+ 360us) client_negotiation.cc:769] Sending connection context
0809 02:28:45.738837 (+ 245us) client_negotiation.cc:240] Negotiation successful
0809 02:28:45.739148 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":129,"threads_started":1}
I20260809 02:28:45.741431 13126 heartbeater.cc:347] Connected to a master server at 127.21.214.190:36419
I20260809 02:28:45.741761 13126 heartbeater.cc:464] Registering TS with master...
I20260809 02:28:45.742316 13126 heartbeater.cc:511] Master 127.21.214.190:36419 requested a full tablet report, sending...
I20260809 02:28:45.743515 12451 ts_manager.cc:194] Registered new tserver with Master: bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589)
I20260809 02:28:45.744256 12451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:50909
I20260809 02:28:45.745818 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:28:45.756425 12506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:45.747978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55492 (local address 127.21.214.190:36419)
0809 02:28:45.748108 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:45.748111 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:45.748340 (+ 229us) server_negotiation.cc:407] Connection header received
0809 02:28:45.748441 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:45.748443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:45.748479 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:45.748545 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:28:45.749346 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.749910 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.751013 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.751282 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.751377 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:45.752939 (+ 1562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:28:45.752942 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:28:45.752945 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:28:45.752971 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:28:45.754646 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:45.755145 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:45.755148 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:45.755150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:45.755259 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:28:45.755569 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:28:45.755573 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:28:45.755574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:28:45.755813 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:28:45.755933 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:45.756197 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 02:28:45.756302 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 02:28:45.759917 12451 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55492:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:28:45.763242 12451 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:28:45.778632 13142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:45.772674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39566 (local address 127.21.214.131:40589)
0809 02:28:45.773279 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:45.773293 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:45.773324 (+ 31us) server_negotiation.cc:407] Connection header received
0809 02:28:45.773414 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:45.773420 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:45.773653 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:45.774350 (+ 697us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:45.774561 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.775509 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.777135 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.777867 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.778015 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:45.778176 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:45.778328 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 02:28:45.778457 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":190,"threads_started":1}
I20260809 02:28:45.778620 13140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:45.772321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:40589 (local address 127.0.0.1:39566)
0809 02:28:45.773163 (+ 842us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:45.773179 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:45.773271 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:45.773871 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:45.773877 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:45.773907 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:45.774156 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:45.774164 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.775670 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.775674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:45.776996 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:45.777006 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.778002 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.778006 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:45.778124 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:45.778167 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 02:28:45.778295 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 02:28:45.778455 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":772,"thread_start_us":90,"threads_started":1}
I20260809 02:28:45.779132 13144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:45.773106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:36393 (local address 127.0.0.1:36678)
0809 02:28:45.773703 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:45.773728 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:45.773819 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:45.774521 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:45.774524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:45.774541 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:45.774727 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:45.774739 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.776169 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.776175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:45.777697 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:45.777705 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.778745 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.778749 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:45.778836 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:45.778859 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:28:45.778914 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 02:28:45.778982 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"mutex_wait_us":362,"thread_start_us":102,"threads_started":1}
I20260809 02:28:45.779296 13139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:45.772285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:35265 (local address 127.0.0.1:60984)
0809 02:28:45.772670 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:45.772730 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:45.772873 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:45.774391 (+ 1518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:45.774397 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:45.774442 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:45.774628 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:45.774636 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.776198 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.776201 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:45.777539 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:45.777550 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.778935 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.778939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:45.779015 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:45.779035 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:28:45.779100 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 02:28:45.779167 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":116,"thread_start_us":100,"threads_started":1}
I20260809 02:28:45.779704 13147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:45.773422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60984 (local address 127.21.214.130:35265)
0809 02:28:45.773899 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:45.773912 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:45.773936 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:28:45.774016 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:45.774021 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:45.774215 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:45.774376 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:45.774768 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.775967 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.777722 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.778596 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.778746 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:45.778874 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:45.779464 (+ 590us) server_negotiation.cc:299] Negotiation successful
0809 02:28:45.779564 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":136,"threads_started":1}
I20260809 02:28:45.779731 13146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:45.773321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36678 (local address 127.21.214.129:36393)
0809 02:28:45.774080 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:45.774095 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:45.774113 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:28:45.774174 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:45.774177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:45.774340 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:45.774675 (+ 335us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:45.774868 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.776005 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.777827 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:45.778609 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:45.779343 (+ 734us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:45.779479 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:45.779523 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 02:28:45.779598 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":113,"threads_started":1}
I20260809 02:28:45.782137 12636 tablet_service.cc:1467] Processing CreateTablet for tablet 9912636c008141b093ebf964087859d2 (DEFAULT_TABLE table=test-table [id=02d3b83afe0f477ab06e3ef00a44a779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:28:45.782143 13028 tablet_service.cc:1467] Processing CreateTablet for tablet 9912636c008141b093ebf964087859d2 (DEFAULT_TABLE table=test-table [id=02d3b83afe0f477ab06e3ef00a44a779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:28:45.783250 12636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9912636c008141b093ebf964087859d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:45.783331 13028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9912636c008141b093ebf964087859d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:45.783102 12839 tablet_service.cc:1467] Processing CreateTablet for tablet 9912636c008141b093ebf964087859d2 (DEFAULT_TABLE table=test-table [id=02d3b83afe0f477ab06e3ef00a44a779]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:28:45.784139 12839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9912636c008141b093ebf964087859d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:28:45.789197 13148 tablet_bootstrap.cc:492] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Bootstrap starting.
I20260809 02:28:45.791553 13148 tablet_bootstrap.cc:654] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:45.791661 13150 tablet_bootstrap.cc:492] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c: Bootstrap starting.
I20260809 02:28:45.792702 13148 log.cc:824] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:45.793486 13151 tablet_bootstrap.cc:492] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37: Bootstrap starting.
I20260809 02:28:45.794589 13150 tablet_bootstrap.cc:654] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:45.794968 13148 tablet_bootstrap.cc:492] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: No bootstrap required, opened a new log
I20260809 02:28:45.795195 13148 ts_tablet_manager.cc:1397] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:28:45.795441 13150 log.cc:824] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:45.796099 13151 tablet_bootstrap.cc:654] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37: Neither blocks nor log segments found. Creating new log.
I20260809 02:28:45.797019 13151 log.cc:824] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37: Log is configured to *not* fsync() on all Append() calls
I20260809 02:28:45.797616 13150 tablet_bootstrap.cc:492] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c: No bootstrap required, opened a new log
I20260809 02:28:45.797861 13150 ts_tablet_manager.cc:1397] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:28:45.799050 13151 tablet_bootstrap.cc:492] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37: No bootstrap required, opened a new log
I20260809 02:28:45.799233 13151 ts_tablet_manager.cc:1397] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:28:45.799638 13148 raft_consensus.cc:348] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:28:45.799906 13148 raft_consensus.cc:374] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:45.799989 13148 raft_consensus.cc:729] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a160f83ae7eb48538c54f55bb3145c02, State: Initialized, Role: FOLLOWER
I20260809 02:28:45.800501 13148 consensus_queue.cc:260] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:28:45.801205 12728 heartbeater.cc:503] Master 127.21.214.190:36419 was elected leader, sending a full tablet report...
I20260809 02:28:45.802011 13150 raft_consensus.cc:348] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:28:45.802352 13150 raft_consensus.cc:374] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:45.802484 13150 raft_consensus.cc:729] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb65ade627674f05b00c95a4d3531c4c, State: Initialized, Role: FOLLOWER
I20260809 02:28:45.802695 13148 ts_tablet_manager.cc:1428] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260809 02:28:45.802999 13150 consensus_queue.cc:260] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:28:45.803092 13151 raft_consensus.cc:348] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:28:45.803361 13151 raft_consensus.cc:374] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:28:45.803478 13151 raft_consensus.cc:729] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0df857ef80004a2398112b70d2256e37, State: Initialized, Role: FOLLOWER
I20260809 02:28:45.803838 13126 heartbeater.cc:503] Master 127.21.214.190:36419 was elected leader, sending a full tablet report...
I20260809 02:28:45.804260 13150 ts_tablet_manager.cc:1428] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:28:45.804183 13151 consensus_queue.cc:260] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:28:45.805011 12943 heartbeater.cc:503] Master 127.21.214.190:36419 was elected leader, sending a full tablet report...
I20260809 02:28:45.805297 13151 ts_tablet_manager.cc:1428] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260809 02:28:45.974517 13127 tablet.cc:2369] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:28:45.997807 12944 tablet.cc:2369] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:28:46.009886 12731 tablet.cc:2369] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:28:46.036734 13157 raft_consensus.cc:482] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:28:46.036981 13157 raft_consensus.cc:504] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:28:46.038344 13157 leader_election.cc:288] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265), a160f83ae7eb48538c54f55bb3145c02 (127.21.214.129:36393)
I20260809 02:28:46.042033 13128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:46.038579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:35265 (local address 127.21.214.131:39233)
0809 02:28:46.038749 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:46.038767 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:46.038896 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:46.039206 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:46.039209 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:46.039228 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:46.039358 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:46.039364 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:46.040105 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:46.040109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:46.040877 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:46.040886 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:46.041537 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:46.041541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:46.041693 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:46.041717 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:28:46.041812 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 02:28:46.041890 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":26}
I20260809 02:28:46.042032 13147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:46.038765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:39233 (local address 127.21.214.130:35265)
0809 02:28:46.038952 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:46.038957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:46.038975 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:28:46.039042 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:46.039048 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:46.039106 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:46.039193 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:46.039478 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:46.039988 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:46.041018 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:46.041416 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:46.041543 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:46.041602 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:46.041831 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 02:28:46.041903 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 02:28:46.042914 13161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:46.038898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:36393 (local address 127.21.214.131:41007)
0809 02:28:46.039303 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:46.039318 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:28:46.039462 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:28:46.039783 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:28:46.039787 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:28:46.039805 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:28:46.039940 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:46.039945 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:46.040739 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:46.040745 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:46.041656 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:28:46.041664 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:28:46.042559 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:28:46.042563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:28:46.042668 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:46.042688 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:28:46.042761 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 02:28:46.042811 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":4,"thread_start_us":141,"threads_started":1}
I20260809 02:28:46.042882 12869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9912636c008141b093ebf964087859d2" candidate_uuid: "bb65ade627674f05b00c95a4d3531c4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0df857ef80004a2398112b70d2256e37" is_pre_election: true
I20260809 02:28:46.043004 13146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:46.039126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:41007 (local address 127.21.214.129:36393)
0809 02:28:46.039269 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:46.039274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:46.039421 (+ 147us) server_negotiation.cc:407] Connection header received
0809 02:28:46.039608 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:46.039611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:46.039667 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:46.039756 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:28:46.040064 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:46.040615 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:46.041796 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:46.042398 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:46.042555 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:46.042627 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:46.042803 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 02:28:46.042875 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:28:46.043241 12869 raft_consensus.cc:2454] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb65ade627674f05b00c95a4d3531c4c in term 0.
I20260809 02:28:46.043608 12661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9912636c008141b093ebf964087859d2" candidate_uuid: "bb65ade627674f05b00c95a4d3531c4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a160f83ae7eb48538c54f55bb3145c02" is_pre_election: true
I20260809 02:28:46.043794 12974 leader_election.cc:302] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0df857ef80004a2398112b70d2256e37, bb65ade627674f05b00c95a4d3531c4c; no voters:
I20260809 02:28:46.043902 12661 raft_consensus.cc:2454] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb65ade627674f05b00c95a4d3531c4c in term 0.
I20260809 02:28:46.044096 13157 raft_consensus.cc:2781] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:28:46.044232 13157 raft_consensus.cc:482] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:28:46.044304 13157 raft_consensus.cc:3037] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:46.045501 13157 raft_consensus.cc:504] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:28:46.045882 13157 leader_election.cc:288] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [CANDIDATE]: Term 1 election: Requested vote from peers 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265), a160f83ae7eb48538c54f55bb3145c02 (127.21.214.129:36393)
I20260809 02:28:46.046232 12869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9912636c008141b093ebf964087859d2" candidate_uuid: "bb65ade627674f05b00c95a4d3531c4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0df857ef80004a2398112b70d2256e37"
I20260809 02:28:46.046284 12661 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9912636c008141b093ebf964087859d2" candidate_uuid: "bb65ade627674f05b00c95a4d3531c4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a160f83ae7eb48538c54f55bb3145c02"
I20260809 02:28:46.046341 12869 raft_consensus.cc:3037] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:46.046448 12661 raft_consensus.cc:3037] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:28:46.047549 12869 raft_consensus.cc:2454] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb65ade627674f05b00c95a4d3531c4c in term 1.
I20260809 02:28:46.047693 12661 raft_consensus.cc:2454] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb65ade627674f05b00c95a4d3531c4c in term 1.
I20260809 02:28:46.047906 12974 leader_election.cc:302] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0df857ef80004a2398112b70d2256e37, bb65ade627674f05b00c95a4d3531c4c; no voters:
I20260809 02:28:46.048107 13157 raft_consensus.cc:2781] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:28:46.048413 13157 raft_consensus.cc:686] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [term 1 LEADER]: Becoming Leader. State: Replica: bb65ade627674f05b00c95a4d3531c4c, State: Running, Role: LEADER
I20260809 02:28:46.048749 13157 consensus_queue.cc:237] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:28:46.052068 12451 catalog_manager.cc:5495] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c reported cstate change: term changed from 0 to 1, leader changed from <none> to bb65ade627674f05b00c95a4d3531c4c (127.21.214.131). New cstate: current_term: 1 leader_uuid: "bb65ade627674f05b00c95a4d3531c4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } health_report { overall_health: UNKNOWN } } }
I20260809 02:28:46.075963 13142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:46.072393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39570 (local address 127.21.214.131:40589)
0809 02:28:46.072529 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:28:46.072534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:28:46.072551 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:28:46.072736 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:28:46.072738 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:28:46.072794 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:28:46.072883 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:28:46.073175 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:46.073669 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:46.074615 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:28:46.074831 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:28:46.074910 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:28:46.075166 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:28:46.075549 (+ 383us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:28:46.075639 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 02:28:46.075708 (+ 69us) server_negotiation.cc:299] Negotiation successful
0809 02:28:46.075772 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:28:46.081907 12661 raft_consensus.cc:1261] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Refusing update from remote peer bb65ade627674f05b00c95a4d3531c4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:28:46.081946 12869 raft_consensus.cc:1261] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37 [term 1 FOLLOWER]: Refusing update from remote peer bb65ade627674f05b00c95a4d3531c4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:28:46.082687 13162 consensus_queue.cc:1035] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:28:46.083079 13157 consensus_queue.cc:1035] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:28:46.091284 13167 mvcc.cc:205] Tried to move back new op lower bound from 7316449386823782400 to 7316449386698354688. Current Snapshot: MvccSnapshot[applied={T|T < 7316449386823782400}]
I20260809 02:28:46.094537 13169 mvcc.cc:205] Tried to move back new op lower bound from 7316449386823782400 to 7316449386698354688. Current Snapshot: MvccSnapshot[applied={T|T < 7316449386823782400}]
I20260809 02:28:46.101032 12449 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:28:46.101190 12449 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:28:46.103673 12449 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Sending DeleteTablet for 3 replicas of tablet 9912636c008141b093ebf964087859d2
I20260809 02:28:46.104516 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 12543
I20260809 02:28:46.104458 13028 tablet_service.cc:1514] Processing DeleteTablet for tablet 9912636c008141b093ebf964087859d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:46 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:39566
I20260809 02:28:46.104525 12839 tablet_service.cc:1514] Processing DeleteTablet for tablet 9912636c008141b093ebf964087859d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:46 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:60984
I20260809 02:28:46.104673 12636 tablet_service.cc:1514] Processing DeleteTablet for tablet 9912636c008141b093ebf964087859d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:46 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:36678
I20260809 02:28:46.113432 13183 tablet_replica.cc:330] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37: stopping tablet replica
I20260809 02:28:46.113763 13184 tablet_replica.cc:330] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c: stopping tablet replica
I20260809 02:28:46.113792 13183 raft_consensus.cc:2229] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:28:46.114136 13183 raft_consensus.cc:2258] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:28:46.114157 13184 raft_consensus.cc:2229] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:28:46.115123 13184 raft_consensus.cc:2258] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:28:46.115991 13183 ts_tablet_manager.cc:1905] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:28:46.116528 13184 ts_tablet_manager.cc:1905] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:28:46.118965 13183 ts_tablet_manager.cc:1918] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:28:46.119149 13183 log.cc:1196] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/9912636c008141b093ebf964087859d2
I20260809 02:28:46.119539 13183 ts_tablet_manager.cc:1939] T 9912636c008141b093ebf964087859d2 P 0df857ef80004a2398112b70d2256e37: Deleting consensus metadata
I20260809 02:28:46.120222 13184 ts_tablet_manager.cc:1918] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:28:46.120412 13184 log.cc:1196] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/9912636c008141b093ebf964087859d2
I20260809 02:28:46.120852 13184 ts_tablet_manager.cc:1939] T 9912636c008141b093ebf964087859d2 P bb65ade627674f05b00c95a4d3531c4c: Deleting consensus metadata
I20260809 02:28:46.120905 12430 catalog_manager.cc:4841] TS 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265): tablet 9912636c008141b093ebf964087859d2 (table test-table [id=02d3b83afe0f477ab06e3ef00a44a779]) successfully deleted
W20260809 02:28:46.121623 12430 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:36393 (error 108)
I20260809 02:28:46.121937 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 12735
I20260809 02:28:46.123670 12428 catalog_manager.cc:4841] TS bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589): tablet 9912636c008141b093ebf964087859d2 (table test-table [id=02d3b83afe0f477ab06e3ef00a44a779]) successfully deleted
I20260809 02:28:46.142104 13139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:28:46.141776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:36393 (local address 127.0.0.1:36692)
0809 02:28:46.141931 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 02:28:46.142017 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:36393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 02:28:46.142340 12430 catalog_manager.cc:4584] TS a160f83ae7eb48538c54f55bb3145c02 (127.21.214.129:36393): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9912636c008141b093ebf964087859d2: Network error: Client connection negotiation failed: client connection to 127.21.214.129:36393: connect: Connection refused (error 111)
I20260809 02:28:46.148329 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 12951
I20260809 02:28:46.158939 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 12404
I20260809 02:29:06.172300 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:36419
--webserver_interface=127.21.214.190
--webserver_port=33289
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:36419
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:06.286649 13187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:06.286998 13187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:06.287088 13187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:06.291188 13187 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 02:29:06.291270 13187 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 02:29:06.291299 13187 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 02:29:06.291333 13187 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:29:06.291378 13187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:06.291414 13187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:06.291450 13187 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:29:06.291486 13187 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:29:06.296876 13187 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:36419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:36419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=33289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:06.298045 13187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:06.299165 13187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:06.313555 13202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:06.313594 13205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:06.313716 13187 server_base.cc:1034] running on GCE node
W20260809 02:29:06.313555 13203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:06.314607 13187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:06.315790 13187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:06.316962 13187 hybrid_clock.cc:648] HybridClock initialized: now 1786242546316935 us; error 42 us; skew 500 ppm
Aug 09 02:29:06 dist-test-slave-68xk krb5kdc[12384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242546, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:06.319988 13187 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:29:06.320992 13187 webserver.cc:460] Webserver started at http://127.21.214.190:33289/ using document root <none> and password file <none>
I20260809 02:29:06.321698 13187 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:06.321790 13187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:06.326133 13187 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:29:06.328583 13214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:06.330040 13187 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:29:06.330245 13187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2"
format_stamp: "Formatted at 2026-08-09 02:28:44 on dist-test-slave-68xk"
server_key: "91e18bf36da4cbc6c9fd6bd9f15ad753"
server_key_iv: "65e8ec348146e9a5e39ce9c43db54397"
server_key_version: "encryptionkey@0"
I20260809 02:29:06.330914 13187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:06.348073 13187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:06.351660 13187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:06.351881 13187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:06.359136 13187 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:36419
I20260809 02:29:06.359529 13285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:36419 every 8 connection(s)
I20260809 02:29:06.360288 13187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:29:06.364718 13286 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:29:06.366387 13286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Bootstrap starting.
I20260809 02:29:06.370638 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 13187
I20260809 02:29:06.371073 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:36393
--local_ip_for_outbound_sockets=127.21.214.129
--tserver_master_addrs=127.21.214.190:36419
--webserver_port=35579
--webserver_interface=127.21.214.129
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:29:06.385325 13286 log.cc:824] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:06.394240 13286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:29:06.394661 13286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Bootstrap complete.
I20260809 02:29:06.398897 13286 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } }
I20260809 02:29:06.399299 13286 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1c41ac87aa4dbeb2a0a2b3d72573d2, State: Initialized, Role: FOLLOWER
I20260809 02:29:06.399803 13286 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } }
I20260809 02:29:06.399924 13286 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:29:06.400017 13286 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:29:06.400125 13286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 1 FOLLOWER]: Advancing to term 2
I20260809 02:29:06.402038 13286 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } }
I20260809 02:29:06.402382 13286 leader_election.cc:302] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac1c41ac87aa4dbeb2a0a2b3d72573d2; no voters:
I20260809 02:29:06.402791 13286 leader_election.cc:288] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 02:29:06.402904 13294 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 02:29:06.403127 13294 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 2 LEADER]: Becoming Leader. State: Replica: ac1c41ac87aa4dbeb2a0a2b3d72573d2, State: Running, Role: LEADER
I20260809 02:29:06.403503 13294 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } }
I20260809 02:29:06.404067 13286 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:29:06.404479 13294 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac1c41ac87aa4dbeb2a0a2b3d72573d2. Latest consensus state: current_term: 2 leader_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } } }
I20260809 02:29:06.404704 13294 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:06.404850 13296 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } } }
I20260809 02:29:06.405051 13296 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:06.405211 13300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:29:06.410079 13300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:29:06.410806 13300 catalog_manager.cc:1259] Loaded cluster ID: 5d439ba8d27b47ddbb8537e16765c69a
I20260809 02:29:06.410876 13300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:29:06.413405 13300 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:29:06.414168 13300 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Loaded TSK: 0
I20260809 02:29:06.435283 13300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Generated new TSK 1
I20260809 02:29:06.435555 13300 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:29:06.489539 13290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:06.489830 13290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:06.489907 13290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:06.494551 13290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:06.494645 13290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:06.494746 13290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:29:06.500686 13290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:36393
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=35579
--tserver_master_addrs=127.21.214.190:36419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:06.501742 13290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:06.502830 13290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:06.513968 13326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:06.513984 13327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:06.514238 13329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:06.514258 13290 server_base.cc:1034] running on GCE node
I20260809 02:29:06.514770 13290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:06.515478 13290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:06.516701 13290 hybrid_clock.cc:648] HybridClock initialized: now 1786242546516676 us; error 42 us; skew 500 ppm
Aug 09 02:29:06 dist-test-slave-68xk krb5kdc[12384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242546, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:06.519660 13290 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:29:06.520589 13290 webserver.cc:460] Webserver started at http://127.21.214.129:35579/ using document root <none> and password file <none>
I20260809 02:29:06.521160 13290 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:06.521278 13290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:06.525642 13290 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:29:06.527972 13340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:06.529572 13290 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 02:29:06.529706 13290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "a160f83ae7eb48538c54f55bb3145c02"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "4aa8fe9af8fc2cb2548b7d34a76be604"
server_key_iv: "7ec23f597ff5195d82b8daceef661317"
server_key_version: "encryptionkey@0"
I20260809 02:29:06.530444 13290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:06.543762 13290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:06.547626 13290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:06.547812 13290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:06.548527 13290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:06.549968 13349 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:29:06.554158 13290 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:29:06.554234 13290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260809 02:29:06.554296 13290 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:29:06.556396 13290 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:29:06.556450 13290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260809 02:29:06.556789 13349 tablet_bootstrap.cc:492] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Bootstrap starting.
I20260809 02:29:06.566869 13290 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:36393
I20260809 02:29:06.567149 13512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:36393 every 8 connection(s)
I20260809 02:29:06.568106 13290 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:29:06.569156 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 13290
I20260809 02:29:06.569780 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:35265
--local_ip_for_outbound_sockets=127.21.214.130
--tserver_master_addrs=127.21.214.190:36419
--webserver_port=38253
--webserver_interface=127.21.214.130
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:29:06.579267 13349 log.cc:824] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:29:06 dist-test-slave-68xk krb5kdc[12384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242546, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:29:06.586197 13518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:06.571565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:54439)
0809 02:29:06.572147 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:06.572207 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:06.573148 (+ 941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:06.574271 (+ 1123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:06.574279 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:06.574765 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:06.575233 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:06.575248 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:06.576560 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:06.576562 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:06.577498 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:06.577509 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:06.578266 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:06.578270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:06.578505 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:06.579134 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:06.579152 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:06.580809 (+ 1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:06.583034 (+ 2225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:06.583043 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:06.583056 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:06.583328 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:06.583697 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:06.583701 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:06.583703 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:06.583849 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:06.584437 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:06.584444 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:06.584717 (+ 273us) client_negotiation.cc:769] Sending connection context
0809 02:29:06.584909 (+ 192us) client_negotiation.cc:240] Negotiation successful
0809 02:29:06.585271 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":151,"threads_started":1}
I20260809 02:29:06.586181 13515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:06.571531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:54439 (local address 127.21.214.190:36419)
0809 02:29:06.572752 (+ 1221us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:06.572771 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:06.572819 (+ 48us) server_negotiation.cc:407] Connection header received
0809 02:29:06.573569 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:06.573580 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:06.573885 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:06.574227 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:06.575421 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:06.576381 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:06.577638 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:06.578101 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:06.578298 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:06.581009 (+ 2711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:06.581014 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:06.581025 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:06.581053 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:06.582904 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:06.583457 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:06.583462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:06.583466 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:06.583581 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:06.583950 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:06.583954 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:06.583956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:06.584309 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:06.584463 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:06.585022 (+ 559us) server_negotiation.cc:299] Negotiation successful
0809 02:29:06.585308 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1083,"thread_start_us":143,"threads_started":1}
I20260809 02:29:06.588974 13513 heartbeater.cc:347] Connected to a master server at 127.21.214.190:36419
I20260809 02:29:06.589102 13349 tablet_bootstrap.cc:492] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:29:06.589241 13513 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:06.589548 13349 tablet_bootstrap.cc:492] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Bootstrap complete.
I20260809 02:29:06.589787 13513 heartbeater.cc:511] Master 127.21.214.190:36419 requested a full tablet report, sending...
I20260809 02:29:06.591224 13349 ts_tablet_manager.cc:1397] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Time spent bootstrapping tablet: real 0.035s user 0.022s sys 0.011s
I20260809 02:29:06.592218 13236 ts_manager.cc:194] Registered new tserver with Master: a160f83ae7eb48538c54f55bb3145c02 (127.21.214.129:36393)
I20260809 02:29:06.594241 13349 raft_consensus.cc:348] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:06.594887 13349 raft_consensus.cc:729] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a160f83ae7eb48538c54f55bb3145c02, State: Initialized, Role: FOLLOWER
I20260809 02:29:06.595474 13349 consensus_queue.cc:260] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:06.595737 13236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:54439
I20260809 02:29:06.596578 13349 ts_tablet_manager.cc:1428] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:29:06.598513 13513 heartbeater.cc:503] Master 127.21.214.190:36419 was elected leader, sending a full tablet report...
Aug 09 02:29:06 dist-test-slave-68xk krb5kdc[12384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242546, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for kudu/127.21.214.129@KRBTEST.COM
I20260809 02:29:06.607733 13521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:06.595011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:36393 (local address 127.0.0.1:50706)
0809 02:29:06.596229 (+ 1218us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:06.596273 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:06.596394 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:06.597308 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:06.597315 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:06.597748 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:06.597881 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:06.597891 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:06.599146 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:06.599149 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:06.600202 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:06.600214 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:06.600818 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:06.600822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:06.600928 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:06.601509 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:06.601524 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:06.603439 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:06.605801 (+ 2362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:06.605811 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:06.605816 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:06.606123 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:06.606461 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:06.606464 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:06.606466 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:06.606568 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:06.607035 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:06.607041 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:06.607174 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 02:29:06.607347 (+ 173us) client_negotiation.cc:240] Negotiation successful
0809 02:29:06.607550 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1048,"thread_start_us":126,"threads_started":1}
I20260809 02:29:06.608317 13524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:06.595765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50706 (local address 127.21.214.129:36393)
0809 02:29:06.596791 (+ 1026us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:06.596804 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:06.596826 (+ 22us) server_negotiation.cc:407] Connection header received
0809 02:29:06.596887 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:06.596892 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:06.597083 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:06.597267 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:06.598021 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:06.599019 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:06.600347 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:06.600690 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:06.600784 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:06.603622 (+ 2838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:06.603633 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:06.603646 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:06.603673 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:06.605641 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:06.606244 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:06.606249 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:06.606250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:06.606339 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:06.606672 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:06.606674 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:06.606675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:06.606915 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:06.607021 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:06.607991 (+ 970us) server_negotiation.cc:299] Negotiation successful
0809 02:29:06.608162 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":936,"thread_start_us":96,"threads_started":1}
I20260809 02:29:06.609287 13415 tablet_service.cc:1514] Processing DeleteTablet for tablet 9912636c008141b093ebf964087859d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:28:46 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:50706
I20260809 02:29:06.610312 13526 tablet_replica.cc:330] stopping tablet replica
I20260809 02:29:06.610641 13526 raft_consensus.cc:2229] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:29:06.610901 13526 raft_consensus.cc:2258] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:06.611876 13526 ts_tablet_manager.cc:1905] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:06.615585 13526 ts_tablet_manager.cc:1918] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:06.615708 13526 log.cc:1196] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal/wals/9912636c008141b093ebf964087859d2
I20260809 02:29:06.616025 13526 ts_tablet_manager.cc:1939] T 9912636c008141b093ebf964087859d2 P a160f83ae7eb48538c54f55bb3145c02: Deleting consensus metadata
I20260809 02:29:06.617792 13220 catalog_manager.cc:4841] TS a160f83ae7eb48538c54f55bb3145c02 (127.21.214.129:36393): tablet 9912636c008141b093ebf964087859d2 (table test-table [id=02d3b83afe0f477ab06e3ef00a44a779]) successfully deleted
W20260809 02:29:06.698158 13516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:06.698520 13516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:06.698623 13516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:06.702765 13516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:06.702863 13516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:06.702965 13516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:29:06.708432 13516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:35265
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=38253
--tserver_master_addrs=127.21.214.190:36419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:06.709713 13516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:06.710813 13516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:06.720660 13534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:06.720647 13535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:06.720647 13538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:06.721009 13516 server_base.cc:1034] running on GCE node
I20260809 02:29:06.721441 13516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:06.722150 13516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:06.723344 13516 hybrid_clock.cc:648] HybridClock initialized: now 1786242546723314 us; error 45 us; skew 500 ppm
Aug 09 02:29:06 dist-test-slave-68xk krb5kdc[12384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242546, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:06.726064 13516 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:29:06.727007 13516 webserver.cc:460] Webserver started at http://127.21.214.130:38253/ using document root <none> and password file <none>
I20260809 02:29:06.727643 13516 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:06.727771 13516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:06.731595 13516 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 02:29:06.733644 13546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:06.734966 13516 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:29:06.735062 13516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "0df857ef80004a2398112b70d2256e37"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "2d77e990d714f43042117e07566ea897"
server_key_iv: "76576e14e343fc165ca0cc0246ba31c8"
server_key_version: "encryptionkey@0"
I20260809 02:29:06.735705 13516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:06.762360 13516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:06.765254 13516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:06.765411 13516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:06.765970 13516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:06.766776 13516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:06.766824 13516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:06.766865 13516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:06.766880 13516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:06.776062 13516 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:35265
I20260809 02:29:06.776106 13723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:35265 every 8 connection(s)
I20260809 02:29:06.777045 13516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:29:06.780445 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 13516
I20260809 02:29:06.780972 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:40589
--local_ip_for_outbound_sockets=127.21.214.131
--tserver_master_addrs=127.21.214.190:36419
--webserver_port=40311
--webserver_interface=127.21.214.131
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 02:29:06 dist-test-slave-68xk krb5kdc[12384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242546, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:29:06.793097 13515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:06.778919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:40175 (local address 127.21.214.190:36419)
0809 02:29:06.779076 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:06.779082 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:06.779985 (+ 903us) server_negotiation.cc:407] Connection header received
0809 02:29:06.781810 (+ 1825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:06.781813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:06.781865 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:06.781943 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:06.783500 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:06.784383 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:06.785555 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:06.786033 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:06.786175 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:06.788936 (+ 2761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:06.788942 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:06.788946 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:06.788982 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:06.790798 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:06.791327 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:06.791332 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:06.791333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:06.791438 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:06.791805 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:06.791812 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:06.791816 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:06.792081 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:06.792195 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:06.792694 (+ 499us) server_negotiation.cc:299] Negotiation successful
0809 02:29:06.792855 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:29:06.793680 13726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:06.779357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:40175)
0809 02:29:06.779831 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:06.779874 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:06.781546 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:06.782153 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:06.782165 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:06.782729 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:06.783335 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:06.783349 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:06.784533 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:06.784535 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:06.785416 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:06.785426 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:06.786195 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:06.786198 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:06.786336 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:06.787022 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:06.787037 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:06.788752 (+ 1715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:06.790918 (+ 2166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:06.790923 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:06.790934 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:06.791217 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:06.791547 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:06.791549 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:06.791551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:06.791700 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:06.792220 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:06.792225 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:06.792443 (+ 218us) client_negotiation.cc:769] Sending connection context
0809 02:29:06.792594 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 02:29:06.792835 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":125,"threads_started":1}
I20260809 02:29:06.794968 13724 heartbeater.cc:347] Connected to a master server at 127.21.214.190:36419
I20260809 02:29:06.795225 13724 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:06.795933 13724 heartbeater.cc:511] Master 127.21.214.190:36419 requested a full tablet report, sending...
I20260809 02:29:06.797082 13236 ts_manager.cc:194] Registered new tserver with Master: 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265)
I20260809 02:29:06.797694 13236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:40175
W20260809 02:29:06.902056 13727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:06.902333 13727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:06.902377 13727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:06.906872 13727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:06.906932 13727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:06.907022 13727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:29:06.912477 13727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:40589
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=40311
--tserver_master_addrs=127.21.214.190:36419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:06.913532 13727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:06.914587 13727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:06.924698 13735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:06.924710 13734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:06.924674 13727 server_base.cc:1034] running on GCE node
W20260809 02:29:06.924652 13737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:06.925335 13727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:06.925921 13727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:06.927089 13727 hybrid_clock.cc:648] HybridClock initialized: now 1786242546927064 us; error 40 us; skew 500 ppm
Aug 09 02:29:06 dist-test-slave-68xk krb5kdc[12384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242546, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:06.930212 13727 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:29:06.931216 13727 webserver.cc:460] Webserver started at http://127.21.214.131:40311/ using document root <none> and password file <none>
I20260809 02:29:06.931850 13727 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:06.931988 13727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:06.936700 13727 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260809 02:29:06.939076 13752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:06.940462 13727 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:29:06.940630 13727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "bb65ade627674f05b00c95a4d3531c4c"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "f59cc2d23fa274f039e65eff74505239"
server_key_iv: "686cd431aabac29fb91a717377d5bc93"
server_key_version: "encryptionkey@0"
I20260809 02:29:06.941205 13727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:06.975765 13727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:06.979573 13727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:06.979813 13727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:06.980501 13727 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:06.981437 13727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:06.981518 13727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:06.981600 13727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:06.981652 13727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:06.991377 13727 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:40589
I20260809 02:29:06.991415 13927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:40589 every 8 connection(s)
I20260809 02:29:06.992470 13727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:29:06.999672 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 13727
Aug 09 02:29:06 dist-test-slave-68xk krb5kdc[12384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242546, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:29:07.010111 13515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:06.994472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:48561 (local address 127.21.214.190:36419)
0809 02:29:06.994628 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:06.994632 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:06.996335 (+ 1703us) server_negotiation.cc:407] Connection header received
0809 02:29:06.997607 (+ 1272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:06.997614 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:06.997681 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:06.997805 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:06.999458 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.000238 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.001705 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.002072 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.002207 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.005333 (+ 3126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:07.005339 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:07.005343 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:07.005377 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:07.007434 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:07.008148 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:07.008152 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:07.008154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:07.008245 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:07.008583 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:07.008586 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:07.008587 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:07.008834 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:07.008957 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:07.009763 (+ 806us) server_negotiation.cc:299] Negotiation successful
0809 02:29:07.009902 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":60}
I20260809 02:29:07.011003 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:07.000462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35018 (local address 127.21.214.190:36419)
0809 02:29:07.000703 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:07.000706 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:07.000970 (+ 264us) server_negotiation.cc:407] Connection header received
0809 02:29:07.001138 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:07.001141 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:07.001234 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:07.001336 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:07.002217 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.003108 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.004252 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.004476 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.004683 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.006900 (+ 2217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:07.006906 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:07.006912 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:07.006960 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:07.009099 (+ 2139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:07.009636 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:07.009639 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:07.009640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:07.009758 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:07.010073 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:07.010076 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:07.010078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:07.010308 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:07.010543 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:07.010680 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 02:29:07.010799 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":159,"thread_start_us":72,"threads_started":1}
I20260809 02:29:07.011469 13931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:06.994859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:48561)
0809 02:29:06.996069 (+ 1210us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:06.996139 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:06.997291 (+ 1152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:06.998248 (+ 957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:06.998278 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:06.998765 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:06.999278 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:06.999292 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.000669 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.000676 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:07.001580 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:07.001591 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.002372 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.002376 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:07.002595 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.003211 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:07.003235 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:07.005145 (+ 1910us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:07.007576 (+ 2431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:07.007582 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:07.007597 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:07.008026 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:07.008340 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:07.008342 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:07.008343 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:07.008470 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:07.008954 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:07.008992 (+ 38us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:07.009448 (+ 456us) client_negotiation.cc:769] Sending connection context
0809 02:29:07.009685 (+ 237us) client_negotiation.cc:240] Negotiation successful
0809 02:29:07.010053 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":928,"thread_start_us":768,"threads_started":1}
I20260809 02:29:07.012841 13928 heartbeater.cc:347] Connected to a master server at 127.21.214.190:36419
I20260809 02:29:07.013103 13928 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:07.013641 13928 heartbeater.cc:511] Master 127.21.214.190:36419 requested a full tablet report, sending...
I20260809 02:29:07.014786 13236 ts_manager.cc:194] Registered new tserver with Master: bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589)
I20260809 02:29:07.015342 13236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:48561
I20260809 02:29:07.026037 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:29:07.030504 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:07.026711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35024 (local address 127.21.214.190:36419)
0809 02:29:07.026864 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:07.026869 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:07.027045 (+ 176us) server_negotiation.cc:407] Connection header received
0809 02:29:07.027252 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:07.027254 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:07.027352 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:07.027465 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:29:07.027720 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.028337 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.029244 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.029468 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.029575 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.029897 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:29:07.030027 (+ 130us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 02:29:07.030320 (+ 293us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35024: token expired
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 02:29:07.030587 13934 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35024: token expired
W20260809 02:29:07.030879 13133 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.21.214.190:36419)
I20260809 02:29:07.038223 13934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:07.031267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35030 (local address 127.21.214.190:36419)
0809 02:29:07.031380 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:07.031383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:07.031396 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:29:07.031489 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:07.031491 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:07.031524 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:07.031588 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:07.032194 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.032644 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.033371 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.033571 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.033693 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.035249 (+ 1556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:07.035252 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:07.035254 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:07.035278 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:07.036884 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:07.037272 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:07.037274 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:07.037275 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:07.037347 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:07.037583 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:07.037585 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:07.037586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:07.037748 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:07.037845 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:07.038031 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 02:29:07.038119 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:29:07.040683 13236 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:29:07.043946 13236 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:29:07.052366 13415 tablet_service.cc:1467] Processing CreateTablet for tablet f72724e4ca0846d48cf74987d5f6353c (DEFAULT_TABLE table=test-table [id=7af54ffe2d5e4f548f58150ab8037283]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:07.053006 13415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f72724e4ca0846d48cf74987d5f6353c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:07.055717 13349 tablet_bootstrap.cc:492] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02: Bootstrap starting.
I20260809 02:29:07.056483 13349 tablet_bootstrap.cc:654] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:07.056686 13941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:07.050947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:40589 (local address 127.0.0.1:41588)
0809 02:29:07.051173 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:07.051186 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:07.051287 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:07.051939 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:07.051942 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:07.051961 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:07.052062 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:07.052068 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.053696 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.053699 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:07.054826 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:07.054834 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.056206 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.056210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:07.056317 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.056361 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 02:29:07.056448 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 02:29:07.056522 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":3,"thread_start_us":94,"threads_started":1}
I20260809 02:29:07.056703 13942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:07.051127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41588 (local address 127.21.214.131:40589)
0809 02:29:07.051474 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:07.051484 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:07.051503 (+ 19us) server_negotiation.cc:407] Connection header received
0809 02:29:07.051596 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:07.051602 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:07.051791 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:07.051965 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:07.052163 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.053546 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.054943 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.056062 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.056219 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.056362 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:07.056479 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 02:29:07.056570 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":119,"threads_started":1}
I20260809 02:29:07.057230 13521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:07.050391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:35265 (local address 127.0.0.1:43566)
0809 02:29:07.050576 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:07.050594 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:07.050670 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:07.051705 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:07.051708 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:07.051726 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:07.051835 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:07.051842 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.053204 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.053207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:07.054530 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:07.054542 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.056753 (+ 2211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.056757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:07.056894 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.056927 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 02:29:07.056987 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 02:29:07.057065 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"mutex_wait_us":27}
I20260809 02:29:07.058068 13940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:07.050689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43566 (local address 127.21.214.130:35265)
0809 02:29:07.051155 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:07.051169 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:07.051206 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:29:07.051296 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:07.051302 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:07.051539 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:07.051726 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:07.051982 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.053077 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.054666 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.055540 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.057606 (+ 2066us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.057770 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:07.057823 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 02:29:07.057922 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":171,"threads_started":1}
I20260809 02:29:07.058182 13349 tablet_bootstrap.cc:492] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02: No bootstrap required, opened a new log
I20260809 02:29:07.058279 13349 ts_tablet_manager.cc:1397] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 02:29:07.058780 13349 raft_consensus.cc:348] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:07.058909 13349 raft_consensus.cc:374] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:07.058957 13349 raft_consensus.cc:729] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a160f83ae7eb48538c54f55bb3145c02, State: Initialized, Role: FOLLOWER
I20260809 02:29:07.059078 13349 consensus_queue.cc:260] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:07.059450 13349 ts_tablet_manager.cc:1428] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 02:29:07.059789 13831 tablet_service.cc:1467] Processing CreateTablet for tablet f72724e4ca0846d48cf74987d5f6353c (DEFAULT_TABLE table=test-table [id=7af54ffe2d5e4f548f58150ab8037283]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:07.060933 13831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f72724e4ca0846d48cf74987d5f6353c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:07.060876 13625 tablet_service.cc:1467] Processing CreateTablet for tablet f72724e4ca0846d48cf74987d5f6353c (DEFAULT_TABLE table=test-table [id=7af54ffe2d5e4f548f58150ab8037283]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:07.061925 13625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f72724e4ca0846d48cf74987d5f6353c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:07.069397 13946 tablet_bootstrap.cc:492] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c: Bootstrap starting.
W20260809 02:29:07.069521 13514 tablet.cc:2369] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:29:07.069878 13948 tablet_bootstrap.cc:492] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37: Bootstrap starting.
I20260809 02:29:07.072284 13946 tablet_bootstrap.cc:654] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:07.072502 13948 tablet_bootstrap.cc:654] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:07.073274 13946 log.cc:824] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:07.073274 13948 log.cc:824] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:07.075138 13948 tablet_bootstrap.cc:492] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37: No bootstrap required, opened a new log
I20260809 02:29:07.075205 13946 tablet_bootstrap.cc:492] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c: No bootstrap required, opened a new log
I20260809 02:29:07.075340 13948 ts_tablet_manager.cc:1397] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:29:07.075415 13946 ts_tablet_manager.cc:1397] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260809 02:29:07.078109 13946 raft_consensus.cc:348] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:07.078100 13948 raft_consensus.cc:348] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:07.078315 13948 raft_consensus.cc:374] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:07.078348 13946 raft_consensus.cc:374] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:07.078377 13948 raft_consensus.cc:729] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0df857ef80004a2398112b70d2256e37, State: Initialized, Role: FOLLOWER
I20260809 02:29:07.078426 13946 raft_consensus.cc:729] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb65ade627674f05b00c95a4d3531c4c, State: Initialized, Role: FOLLOWER
I20260809 02:29:07.078853 13948 consensus_queue.cc:260] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:07.078855 13946 consensus_queue.cc:260] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:07.079495 13724 heartbeater.cc:503] Master 127.21.214.190:36419 was elected leader, sending a full tablet report...
I20260809 02:29:07.079807 13948 ts_tablet_manager.cc:1428] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260809 02:29:07.079830 13946 ts_tablet_manager.cc:1428] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260809 02:29:07.080102 13928 heartbeater.cc:503] Master 127.21.214.190:36419 was elected leader, sending a full tablet report...
I20260809 02:29:07.082087 13954 raft_consensus.cc:482] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:29:07.082232 13954 raft_consensus.cc:504] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:07.083299 13954 leader_election.cc:288] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265), a160f83ae7eb48538c54f55bb3145c02 (127.21.214.129:36393)
I20260809 02:29:07.087522 13931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:07.083542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:35265 (local address 127.21.214.131:54781)
0809 02:29:07.083683 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:07.083708 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:07.083796 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:07.084154 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:07.084160 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:07.084178 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:07.084325 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:07.084336 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.085327 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.085330 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:07.086352 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:07.086363 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.087090 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.087092 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:07.087234 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.087260 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:29:07.087346 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 02:29:07.087418 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"spinlock_wait_cycles":9472}
I20260809 02:29:07.087568 13940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:07.083574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:54781 (local address 127.21.214.130:35265)
0809 02:29:07.083688 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:07.083695 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:07.083752 (+ 57us) server_negotiation.cc:407] Connection header received
0809 02:29:07.083903 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:07.083906 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:07.083950 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:07.084038 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:07.084434 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.085190 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.086519 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.086933 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.087063 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.087113 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:07.087380 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 02:29:07.087452 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:29:07.088157 13660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f72724e4ca0846d48cf74987d5f6353c" candidate_uuid: "bb65ade627674f05b00c95a4d3531c4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0df857ef80004a2398112b70d2256e37" is_pre_election: true
I20260809 02:29:07.088358 13956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:07.083794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:36393 (local address 127.21.214.131:58109)
0809 02:29:07.084104 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:07.084118 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:07.084198 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:07.084894 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:07.084897 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:07.084914 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:07.085017 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:07.085022 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.085856 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.085860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:07.086862 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:07.086871 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.087966 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.087969 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:07.088059 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.088078 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 02:29:07.088139 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 02:29:07.088189 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"spinlock_wait_cycles":1408,"thread_start_us":136,"threads_started":1}
I20260809 02:29:07.088400 13524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:07.084521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:58109 (local address 127.21.214.129:36393)
0809 02:29:07.084645 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:07.084650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:07.084663 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:29:07.084712 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:07.084715 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:07.084773 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:07.084867 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:07.085152 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.085731 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.086983 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.087616 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.087757 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.087902 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:07.088197 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 02:29:07.088284 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:29:07.088438 13660 raft_consensus.cc:2454] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb65ade627674f05b00c95a4d3531c4c in term 0.
I20260809 02:29:07.088994 13444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f72724e4ca0846d48cf74987d5f6353c" candidate_uuid: "bb65ade627674f05b00c95a4d3531c4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a160f83ae7eb48538c54f55bb3145c02" is_pre_election: true
I20260809 02:29:07.089074 13757 leader_election.cc:302] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0df857ef80004a2398112b70d2256e37, bb65ade627674f05b00c95a4d3531c4c; no voters:
I20260809 02:29:07.089277 13444 raft_consensus.cc:2454] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb65ade627674f05b00c95a4d3531c4c in term 0.
I20260809 02:29:07.089350 13954 raft_consensus.cc:2781] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:29:07.089430 13954 raft_consensus.cc:482] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:29:07.089488 13954 raft_consensus.cc:3037] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:07.090571 13954 raft_consensus.cc:504] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:07.090899 13954 leader_election.cc:288] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [CANDIDATE]: Term 1 election: Requested vote from peers 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265), a160f83ae7eb48538c54f55bb3145c02 (127.21.214.129:36393)
I20260809 02:29:07.091351 13444 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f72724e4ca0846d48cf74987d5f6353c" candidate_uuid: "bb65ade627674f05b00c95a4d3531c4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a160f83ae7eb48538c54f55bb3145c02"
I20260809 02:29:07.091401 13660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f72724e4ca0846d48cf74987d5f6353c" candidate_uuid: "bb65ade627674f05b00c95a4d3531c4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0df857ef80004a2398112b70d2256e37"
I20260809 02:29:07.091490 13444 raft_consensus.cc:3037] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:07.091521 13660 raft_consensus.cc:3037] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:07.092502 13444 raft_consensus.cc:2454] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb65ade627674f05b00c95a4d3531c4c in term 1.
I20260809 02:29:07.092568 13660 raft_consensus.cc:2454] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb65ade627674f05b00c95a4d3531c4c in term 1.
I20260809 02:29:07.092798 13757 leader_election.cc:302] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a160f83ae7eb48538c54f55bb3145c02, bb65ade627674f05b00c95a4d3531c4c; no voters:
I20260809 02:29:07.092974 13954 raft_consensus.cc:2781] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:07.093230 13954 raft_consensus.cc:686] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [term 1 LEADER]: Becoming Leader. State: Replica: bb65ade627674f05b00c95a4d3531c4c, State: Running, Role: LEADER
I20260809 02:29:07.093531 13954 consensus_queue.cc:237] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:07.096619 13235 catalog_manager.cc:5495] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c reported cstate change: term changed from 0 to 1, leader changed from <none> to bb65ade627674f05b00c95a4d3531c4c (127.21.214.131). New cstate: current_term: 1 leader_uuid: "bb65ade627674f05b00c95a4d3531c4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } health_report { overall_health: UNKNOWN } } }
I20260809 02:29:07.106974 13942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:07.103086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41594 (local address 127.21.214.131:40589)
0809 02:29:07.103222 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:07.103226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:07.103241 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:29:07.103330 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:07.103332 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:07.103383 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:07.103476 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:29:07.103675 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.104274 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.105334 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:07.105611 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:07.105740 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:07.106112 (+ 372us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:29:07.106592 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:29:07.106692 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:07.106821 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 02:29:07.106869 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:29:07.113062 13660 raft_consensus.cc:1261] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37 [term 1 FOLLOWER]: Refusing update from remote peer bb65ade627674f05b00c95a4d3531c4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:07.113059 13444 raft_consensus.cc:1261] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Refusing update from remote peer bb65ade627674f05b00c95a4d3531c4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:07.113767 13954 consensus_queue.cc:1035] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:07.114027 13957 consensus_queue.cc:1035] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:07.121838 13965 mvcc.cc:205] Tried to move back new op lower bound from 7316449472967757824 to 7316449472897482752. Current Snapshot: MvccSnapshot[applied={T|T < 7316449472967757824}]
I20260809 02:29:07.131783 13235 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:07.131986 13235 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:07.134581 13235 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Sending DeleteTablet for 3 replicas of tablet f72724e4ca0846d48cf74987d5f6353c
I20260809 02:29:07.135380 13625 tablet_service.cc:1514] Processing DeleteTablet for tablet f72724e4ca0846d48cf74987d5f6353c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:07 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:43566
I20260809 02:29:07.135663 13831 tablet_service.cc:1514] Processing DeleteTablet for tablet f72724e4ca0846d48cf74987d5f6353c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:07 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:41588
I20260809 02:29:07.135836 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 13290
I20260809 02:29:07.135895 13415 tablet_service.cc:1514] Processing DeleteTablet for tablet f72724e4ca0846d48cf74987d5f6353c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:07 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:50706
I20260809 02:29:07.135988 13979 tablet_replica.cc:330] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37: stopping tablet replica
I20260809 02:29:07.136359 13979 raft_consensus.cc:2229] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:29:07.136683 13979 raft_consensus.cc:2258] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:07.145251 13980 tablet_replica.cc:330] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c: stopping tablet replica
I20260809 02:29:07.145586 13980 raft_consensus.cc:2229] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:29:07.145993 13980 raft_consensus.cc:2258] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:07.148154 13979 ts_tablet_manager.cc:1905] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:07.148979 13980 ts_tablet_manager.cc:1905] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:07.152053 13980 ts_tablet_manager.cc:1918] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:07.152249 13980 log.cc:1196] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/f72724e4ca0846d48cf74987d5f6353c
I20260809 02:29:07.152401 13979 ts_tablet_manager.cc:1918] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:07.152520 13979 log.cc:1196] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/f72724e4ca0846d48cf74987d5f6353c
I20260809 02:29:07.152940 13980 ts_tablet_manager.cc:1939] T f72724e4ca0846d48cf74987d5f6353c P bb65ade627674f05b00c95a4d3531c4c: Deleting consensus metadata
I20260809 02:29:07.152949 13979 ts_tablet_manager.cc:1939] T f72724e4ca0846d48cf74987d5f6353c P 0df857ef80004a2398112b70d2256e37: Deleting consensus metadata
I20260809 02:29:07.154378 13219 catalog_manager.cc:4841] TS bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589): tablet f72724e4ca0846d48cf74987d5f6353c (table test-table [id=7af54ffe2d5e4f548f58150ab8037283]) successfully deleted
I20260809 02:29:07.154470 13220 catalog_manager.cc:4841] TS 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265): tablet f72724e4ca0846d48cf74987d5f6353c (table test-table [id=7af54ffe2d5e4f548f58150ab8037283]) successfully deleted
W20260809 02:29:07.155421 13220 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:36393 (error 108)
I20260809 02:29:07.156037 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 13516
I20260809 02:29:07.159108 13941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:07.158719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:36393 (local address 127.0.0.1:50710)
0809 02:29:07.158924 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:07.159002 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:36393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
W20260809 02:29:07.159307 13220 catalog_manager.cc:4584] TS a160f83ae7eb48538c54f55bb3145c02 (127.21.214.129:36393): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f72724e4ca0846d48cf74987d5f6353c: Network error: Client connection negotiation failed: client connection to 127.21.214.129:36393: connect: Connection refused (error 111)
I20260809 02:29:07.166507 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 13727
I20260809 02:29:07.182307 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 13187
I20260809 02:29:27.194604 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:36419
--webserver_interface=127.21.214.190
--webserver_port=33289
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:36419
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:27.308310 13982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:27.308571 13982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:27.308611 13982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:27.312561 13982 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 02:29:27.312615 13982 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 02:29:27.312631 13982 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 02:29:27.312645 13982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:29:27.312665 13982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:27.312685 13982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:27.312700 13982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:29:27.312721 13982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:29:27.317833 13982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:36419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:36419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=33289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:27.318907 13982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:27.319907 13982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:27.329017 13993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:27.329085 13982 server_base.cc:1034] running on GCE node
W20260809 02:29:27.329021 13989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:27.329011 13991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:27.329880 13982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:27.331137 13982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:27.332346 13982 hybrid_clock.cc:648] HybridClock initialized: now 1786242567332327 us; error 38 us; skew 500 ppm
Aug 09 02:29:27 dist-test-slave-68xk krb5kdc[12384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242567, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:27.335695 13982 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:29:27.336680 13982 webserver.cc:460] Webserver started at http://127.21.214.190:33289/ using document root <none> and password file <none>
I20260809 02:29:27.337237 13982 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:27.337303 13982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:27.341306 13982 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:29:27.343508 14004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:27.344820 13982 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:29:27.344964 13982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2"
format_stamp: "Formatted at 2026-08-09 02:28:44 on dist-test-slave-68xk"
server_key: "91e18bf36da4cbc6c9fd6bd9f15ad753"
server_key_iv: "65e8ec348146e9a5e39ce9c43db54397"
server_key_version: "encryptionkey@0"
I20260809 02:29:27.345520 13982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:27.360507 13982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:27.363821 13982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:27.364035 13982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:27.371776 13982 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:36419
I20260809 02:29:27.372076 14081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:36419 every 8 connection(s)
I20260809 02:29:27.372993 13982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:29:27.377411 14082 sys_catalog.cc:263] Verifying existing consensus state
I20260809 02:29:27.379206 14082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Bootstrap starting.
I20260809 02:29:27.382736 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 13982
I20260809 02:29:27.383234 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:36393
--local_ip_for_outbound_sockets=127.21.214.129
--tserver_master_addrs=127.21.214.190:36419
--webserver_port=35579
--webserver_interface=127.21.214.129
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:29:27.399145 14082 log.cc:824] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:27.411079 14082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:29:27.411522 14082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: Bootstrap complete.
I20260809 02:29:27.415817 14082 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } }
I20260809 02:29:27.416217 14082 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac1c41ac87aa4dbeb2a0a2b3d72573d2, State: Initialized, Role: FOLLOWER
I20260809 02:29:27.416706 14082 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } }
I20260809 02:29:27.416823 14082 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:29:27.416909 14082 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:29:27.417045 14082 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 2 FOLLOWER]: Advancing to term 3
I20260809 02:29:27.419054 14082 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } }
I20260809 02:29:27.419401 14082 leader_election.cc:302] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac1c41ac87aa4dbeb2a0a2b3d72573d2; no voters:
I20260809 02:29:27.419771 14082 leader_election.cc:288] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 02:29:27.419860 14086 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 02:29:27.420042 14086 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [term 3 LEADER]: Becoming Leader. State: Replica: ac1c41ac87aa4dbeb2a0a2b3d72573d2, State: Running, Role: LEADER
I20260809 02:29:27.420401 14086 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } }
I20260809 02:29:27.421029 14082 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:29:27.421756 14088 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } } }
I20260809 02:29:27.421885 14088 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:27.422690 14090 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac1c41ac87aa4dbeb2a0a2b3d72573d2. Latest consensus state: current_term: 3 leader_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac1c41ac87aa4dbeb2a0a2b3d72573d2" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 36419 } } }
I20260809 02:29:27.422868 14090 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2 [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:27.426363 14109 catalog_manager.cc:1259] Loaded cluster ID: 5d439ba8d27b47ddbb8537e16765c69a
I20260809 02:29:27.426443 14109 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: loading cluster ID for follower catalog manager: success
I20260809 02:29:27.429001 14109 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ac1c41ac87aa4dbeb2a0a2b3d72573d2: acquiring CA information for follower catalog manager: success
F20260809 02:29:27.430226 14109 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc14a7699ad google::LogMessage::Fail() at ??:0
@ 0x7fc14a76c88a google::LogMessage::SendToLog() at ??:0
@ 0x7fc14a7694de google::LogMessage::Flush() at ??:0
@ 0x7fc14a76aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc14d42d18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fc1550ce989 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7fc1550ab023 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7fc1550ab54b kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7fc1550a4652 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7fc1550a39e9 _ZZN4kudu6master21CatalogManagerBgTasks4InitEvENKUlvE_clEv at ??:0
@ 0x7fc1550ea541 _ZNSt17_Function_handlerIFvvEZN4kudu6master21CatalogManagerBgTasks4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fc14c9ac512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc14dff06db start_thread at ??:0
@ 0x7fc14926761f clone at ??:0
W20260809 02:29:27.522801 14084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:27.523082 14084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:27.523171 14084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:27.527204 14084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:27.527283 14084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:27.527374 14084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:29:27.532696 14084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:36393
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=35579
--tserver_master_addrs=127.21.214.190:36419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:27.533785 14084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:27.534854 14084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:27.544747 14149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:27.544752 14147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:27.544760 14145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:27.545333 14084 server_base.cc:1034] running on GCE node
I20260809 02:29:27.545775 14084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:27.546556 14084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:27.547746 14084 hybrid_clock.cc:648] HybridClock initialized: now 1786242567547716 us; error 49 us; skew 500 ppm
Aug 09 02:29:27 dist-test-slave-68xk krb5kdc[12384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242567, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:27.550782 14084 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:29:27.551908 14084 webserver.cc:460] Webserver started at http://127.21.214.129:35579/ using document root <none> and password file <none>
I20260809 02:29:27.552683 14084 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:27.552793 14084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:27.558213 14084 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:29:27.561090 14162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:27.562786 14084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:29:27.562925 14084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "a160f83ae7eb48538c54f55bb3145c02"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "4aa8fe9af8fc2cb2548b7d34a76be604"
server_key_iv: "7ec23f597ff5195d82b8daceef661317"
server_key_version: "encryptionkey@0"
I20260809 02:29:27.563714 14084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:27.592103 14084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:27.596323 14084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:27.596560 14084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:27.597407 14084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:27.598935 14169 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 02:29:27.603292 14084 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 02:29:27.603376 14084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260809 02:29:27.603446 14084 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 02:29:27.605917 14084 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 02:29:27.605983 14084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20260809 02:29:27.606356 14169 tablet_bootstrap.cc:492] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02: Bootstrap starting.
I20260809 02:29:27.617990 14084 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:36393
I20260809 02:29:27.618338 14327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:36393 every 8 connection(s)
I20260809 02:29:27.619347 14084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:29:27.621744 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 14084
I20260809 02:29:27.622233 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:35265
--local_ip_for_outbound_sockets=127.21.214.130
--tserver_master_addrs=127.21.214.190:36419
--webserver_port=38253
--webserver_interface=127.21.214.130
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:29:27.628458 14169 log.cc:824] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:27.638774 14169 tablet_bootstrap.cc:492] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 02:29:27.639225 14169 tablet_bootstrap.cc:492] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02: Bootstrap complete.
I20260809 02:29:27.640892 14169 ts_tablet_manager.cc:1397] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02: Time spent bootstrapping tablet: real 0.035s user 0.017s sys 0.015s
I20260809 02:29:27.644150 14169 raft_consensus.cc:348] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:27.644719 14169 raft_consensus.cc:729] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a160f83ae7eb48538c54f55bb3145c02, State: Initialized, Role: FOLLOWER
I20260809 02:29:27.645318 14169 consensus_queue.cc:260] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:27.646431 14169 ts_tablet_manager.cc:1428] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02: Time spent starting tablet: real 0.005s user 0.003s sys 0.005s
W20260809 02:29:27.690917 14332 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:29:27.621794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:59771)
0809 02:29:27.622384 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:27.622468 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:27.623719 (+ 1251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:27.689909 (+ 66190us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":174,"threads_started":1}
W20260809 02:29:27.691603 14328 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:36419 (0 consecutive failures): Network error: Failed to ping master at 127.21.214.190:36419: Client connection negotiation failed: client connection to 127.21.214.190:36419: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 02:29:27.692432 14332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:27.692140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:55931)
0809 02:29:27.692282 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:27.692371 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 02:29:27.693218 14332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:27.692984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:59685)
0809 02:29:27.693103 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:27.693153 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 02:29:27.693467 14328 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:29:27.749730 14333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:27.750010 14333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:27.750083 14333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:27.754118 14333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:27.754201 14333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:27.754294 14333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:29:27.759443 14333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:35265
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=38253
--tserver_master_addrs=127.21.214.190:36419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:27.760468 14333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:27.761518 14333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:27.771999 14348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:27.771919 14345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:27.771926 14344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:27.772094 14333 server_base.cc:1034] running on GCE node
I20260809 02:29:27.772718 14333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:27.773370 14333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:27.774498 14333 hybrid_clock.cc:648] HybridClock initialized: now 1786242567774486 us; error 27 us; skew 500 ppm
Aug 09 02:29:27 dist-test-slave-68xk krb5kdc[12384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242567, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:27.777304 14333 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:29:27.778180 14333 webserver.cc:460] Webserver started at http://127.21.214.130:38253/ using document root <none> and password file <none>
I20260809 02:29:27.778792 14333 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:27.778857 14333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:27.782693 14333 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:29:27.784752 14361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:27.786243 14333 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:29:27.786468 14333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "0df857ef80004a2398112b70d2256e37"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "2d77e990d714f43042117e07566ea897"
server_key_iv: "76576e14e343fc165ca0cc0246ba31c8"
server_key_version: "encryptionkey@0"
I20260809 02:29:27.787091 14333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:27.815598 14333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:27.819742 14333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:27.819999 14333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:27.820750 14333 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:27.821717 14333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:27.821798 14333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:27.821869 14333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:27.821928 14333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:27.832623 14333 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:35265
I20260809 02:29:27.832655 14521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:35265 every 8 connection(s)
I20260809 02:29:27.833735 14333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:29:27.835912 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 14333
I20260809 02:29:27.836422 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:40589
--local_ip_for_outbound_sockets=127.21.214.131
--tserver_master_addrs=127.21.214.190:36419
--webserver_port=40311
--webserver_interface=127.21.214.131
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:29:27.838231 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:27.836278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:37823)
0809 02:29:27.836906 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:27.837476 (+ 570us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":171,"threads_started":1}
W20260809 02:29:27.838757 14522 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:36419 (0 consecutive failures): Network error: Failed to ping master at 127.21.214.190:36419: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
I20260809 02:29:27.839525 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:27.839263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:50059)
0809 02:29:27.839401 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:27.839457 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 02:29:27.840219 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:27.839989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:48929)
0809 02:29:27.840105 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:27.840152 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 02:29:27.840472 14522 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 02:29:27.957013 14526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:27.957302 14526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:27.957348 14526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:27.961575 14526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:27.961650 14526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:27.961714 14526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:29:27.967545 14526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:40589
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=40311
--tserver_master_addrs=127.21.214.190:36419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14526
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:27.968684 14526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:27.969803 14526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:27.980185 14536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:27.980213 14534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:27.980232 14532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:27.980600 14526 server_base.cc:1034] running on GCE node
I20260809 02:29:27.981038 14526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:27.981716 14526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:27.982899 14526 hybrid_clock.cc:648] HybridClock initialized: now 1786242567982863 us; error 49 us; skew 500 ppm
Aug 09 02:29:27 dist-test-slave-68xk krb5kdc[12384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242567, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:27.986035 14526 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:29:27.987360 14526 webserver.cc:460] Webserver started at http://127.21.214.131:40311/ using document root <none> and password file <none>
I20260809 02:29:27.988060 14526 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:27.988127 14526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:27.992328 14526 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:29:27.994638 14546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:27.995981 14526 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:29:27.996083 14526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "bb65ade627674f05b00c95a4d3531c4c"
format_stamp: "Formatted at 2026-08-09 02:28:45 on dist-test-slave-68xk"
server_key: "f59cc2d23fa274f039e65eff74505239"
server_key_iv: "686cd431aabac29fb91a717377d5bc93"
server_key_version: "encryptionkey@0"
I20260809 02:29:27.996675 14526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:28.037878 14526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:28.041312 14526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:28.041580 14526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:28.042308 14526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:28.043277 14526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:28.043357 14526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:28.043433 14526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:28.043478 14526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:28.053720 14526 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:40589
I20260809 02:29:28.053785 14709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:40589 every 8 connection(s)
I20260809 02:29:28.054852 14526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:29:28.055533 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 14526
I20260809 02:29:28.059273 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:28.057375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:47381)
0809 02:29:28.057883 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:28.058332 (+ 449us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":127,"threads_started":1}
W20260809 02:29:28.059813 14711 heartbeater.cc:644] Failed to heartbeat to 127.21.214.190:36419 (0 consecutive failures): Network error: Failed to ping master at 127.21.214.190:36419: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
I20260809 02:29:28.060465 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:28.060217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:39031)
0809 02:29:28.060338 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:28.060414 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 02:29:28.061156 14714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:28.060937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:43355)
0809 02:29:28.061045 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:28.061094 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 02:29:28.061362 14711 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 02:29:28.694743 14715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:28.694176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:53759)
0809 02:29:28.694551 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:28.694617 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":76,"threads_started":1}
I20260809 02:29:28.841729 14716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:28.841217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:57355)
0809 02:29:28.841528 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:28.841600 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":87,"threads_started":1}
I20260809 02:29:29.062485 14718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:29.061959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:44405)
0809 02:29:29.062267 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:29.062322 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":126,"threads_started":1}
I20260809 02:29:29.104578 14719 raft_consensus.cc:482] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:29:29.104774 14719 raft_consensus.cc:504] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:29.105904 14719 leader_election.cc:288] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265), bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589)
Aug 09 02:29:29 dist-test-slave-68xk krb5kdc[12384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242567, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.130@KRBTEST.COM
Aug 09 02:29:29 dist-test-slave-68xk krb5kdc[12384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242567, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.131@KRBTEST.COM
I20260809 02:29:29.121306 14720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:29.106337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:46685 (local address 127.21.214.131:40589)
0809 02:29:29.106807 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:29.106836 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:29.106889 (+ 53us) server_negotiation.cc:407] Connection header received
0809 02:29:29.107977 (+ 1088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:29.107985 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:29.108368 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:29.108694 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:29.110000 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:29.111148 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:29.112299 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:29.112807 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:29.113013 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:29.116245 (+ 3232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:29.116251 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:29.116262 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:29.116291 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:29.118275 (+ 1984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:29.119063 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:29.119075 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:29.119079 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:29.119209 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:29.119606 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:29.119608 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:29.119609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:29.120049 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:29.120222 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:29.120824 (+ 602us) server_negotiation.cc:299] Negotiation successful
0809 02:29:29.121098 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":137,"threads_started":1}
I20260809 02:29:29.121292 14715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:29.106154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:40589 (local address 127.21.214.129:46685)
0809 02:29:29.106518 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:29.106535 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:29.106655 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:29.108769 (+ 2114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:29.108776 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:29.109325 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:29.109807 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:29.109822 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:29.111303 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:29.111306 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:29.112161 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:29.112171 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:29.112951 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:29.112955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:29.113171 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:29.113838 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:29.113856 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:29.116025 (+ 2169us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:29.118402 (+ 2377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:29.118429 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:29.118445 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:29.118921 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:29.119334 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:29.119337 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:29.119338 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:29.119484 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:29.120196 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:29.120203 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:29.120482 (+ 279us) client_negotiation.cc:769] Sending connection context
0809 02:29:29.120676 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 02:29:29.121095 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":138,"spinlock_wait_cycles":57472}
I20260809 02:29:29.121332 14722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:29.106480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:59845 (local address 127.21.214.130:35265)
0809 02:29:29.106905 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:29.106924 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:29.106982 (+ 58us) server_negotiation.cc:407] Connection header received
0809 02:29:29.108049 (+ 1067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:29.108056 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:29.108368 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:29.108614 (+ 246us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:29.109992 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:29.111081 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:29.112295 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:29.112775 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:29.112956 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:29.115925 (+ 2969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:29.115934 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:29.115954 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:29.115991 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:29.117972 (+ 1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:29.119345 (+ 1373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:29.119350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:29.119354 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:29.119472 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:29.119822 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:29.119825 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:29.119826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:29.120198 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:29.120385 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:29.120818 (+ 433us) server_negotiation.cc:299] Negotiation successful
0809 02:29:29.121124 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":134,"threads_started":1}
I20260809 02:29:29.121397 14721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:29.106181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:35265 (local address 127.21.214.129:59845)
0809 02:29:29.106847 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:29.106864 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:29.106976 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:29.109025 (+ 2049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:29.109028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:29.109317 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:29.109806 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:29.109823 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:29.111240 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:29.111243 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:29.112156 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:29.112165 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:29.112910 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:29.112913 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:29.113167 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:29.113892 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:29.113904 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:29.115652 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:29.118564 (+ 2912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:29.118568 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:29.118570 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:29.118921 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:29.119585 (+ 664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:29.119588 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:29.119591 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:29.119685 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:29.120352 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:29.120355 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:29.120494 (+ 139us) client_negotiation.cc:769] Sending connection context
0809 02:29:29.120676 (+ 182us) client_negotiation.cc:240] Negotiation successful
0809 02:29:29.121194 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"mutex_wait_us":445,"spinlock_wait_cycles":17408,"thread_start_us":71,"threads_started":1}
W20260809 02:29:29.124248 14165 leader_election.cc:341] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589): Not found: Tablet not found: f72724e4ca0846d48cf74987d5f6353c
W20260809 02:29:29.124897 14166 leader_election.cc:341] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265): Not found: Tablet not found: f72724e4ca0846d48cf74987d5f6353c
I20260809 02:29:29.125001 14166 leader_election.cc:302] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a160f83ae7eb48538c54f55bb3145c02; no voters: 0df857ef80004a2398112b70d2256e37, bb65ade627674f05b00c95a4d3531c4c
I20260809 02:29:29.125335 14719 raft_consensus.cc:2726] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:29:29.696183 14724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:29.695651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:34271)
0809 02:29:29.695964 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:29.696030 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":85,"threads_started":1}
I20260809 02:29:29.843431 14725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:29.842884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:52691)
0809 02:29:29.843254 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:29.843331 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":93,"threads_started":1}
I20260809 02:29:30.063730 14726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:30.063269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:60489)
0809 02:29:30.063550 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:30.063632 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":77,"threads_started":1}
I20260809 02:29:30.697525 14727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:30.697030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:43737)
0809 02:29:30.697360 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:30.697421 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":78,"threads_started":1}
I20260809 02:29:30.844913 14729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:30.844409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:40023)
0809 02:29:30.844724 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:30.844790 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":87,"threads_started":1}
I20260809 02:29:31.064949 14730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:31.064499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:32809)
0809 02:29:31.064788 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:31.064841 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":116,"threads_started":1}
I20260809 02:29:31.172472 14732 raft_consensus.cc:482] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:29:31.172672 14732 raft_consensus.cc:504] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:31.173148 14732 leader_election.cc:288] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265), bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589)
W20260809 02:29:31.174149 14166 leader_election.cc:341] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265): Not found: Tablet not found: f72724e4ca0846d48cf74987d5f6353c
W20260809 02:29:31.174317 14165 leader_election.cc:341] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589): Not found: Tablet not found: f72724e4ca0846d48cf74987d5f6353c
I20260809 02:29:31.174460 14165 leader_election.cc:302] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a160f83ae7eb48538c54f55bb3145c02; no voters: 0df857ef80004a2398112b70d2256e37, bb65ade627674f05b00c95a4d3531c4c
I20260809 02:29:31.174621 14732 raft_consensus.cc:2726] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:29:31.698904 14735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:31.698486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:55539)
0809 02:29:31.698746 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:31.698802 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":76,"threads_started":1}
I20260809 02:29:31.846460 14736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:31.845812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:37593)
0809 02:29:31.846118 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:31.846269 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":85,"threads_started":1}
I20260809 02:29:32.066094 14739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:32.065659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:33343)
0809 02:29:32.065949 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:32.066003 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":109,"threads_started":1}
I20260809 02:29:32.700775 14741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:32.699919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:46097)
0809 02:29:32.700603 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:32.700658 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":460,"threads_started":1}
I20260809 02:29:32.847914 14742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:32.847459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:47823)
0809 02:29:32.847748 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:32.847812 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":83,"threads_started":1}
I20260809 02:29:33.067338 14743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:33.066908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:60811)
0809 02:29:33.067184 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:33.067242 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":97,"threads_started":1}
I20260809 02:29:33.702016 14744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:33.701558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:40293)
0809 02:29:33.701857 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:33.701914 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":93,"threads_started":1}
I20260809 02:29:33.849298 14745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:33.848799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:58135)
0809 02:29:33.849118 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:33.849186 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":82,"threads_started":1}
I20260809 02:29:33.999799 14746 raft_consensus.cc:482] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:29:33.999949 14746 raft_consensus.cc:504] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:34.000489 14746 leader_election.cc:288] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265), bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589)
W20260809 02:29:34.001461 14166 leader_election.cc:341] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265): Not found: Tablet not found: f72724e4ca0846d48cf74987d5f6353c
W20260809 02:29:34.001583 14165 leader_election.cc:341] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589): Not found: Tablet not found: f72724e4ca0846d48cf74987d5f6353c
I20260809 02:29:34.001644 14165 leader_election.cc:302] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a160f83ae7eb48538c54f55bb3145c02; no voters: 0df857ef80004a2398112b70d2256e37, bb65ade627674f05b00c95a4d3531c4c
I20260809 02:29:34.001796 14746 raft_consensus.cc:2726] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:29:34.068581 14747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:34.068125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:37129)
0809 02:29:34.068407 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:34.068471 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":101,"threads_started":1}
I20260809 02:29:34.704802 14748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:34.703007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:39001)
0809 02:29:34.704637 (+ 1630us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:34.704696 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1535,"thread_start_us":1439,"threads_started":1}
I20260809 02:29:34.850771 14749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:34.850220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:58163)
0809 02:29:34.850607 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:34.850669 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":81,"threads_started":1}
I20260809 02:29:35.069923 14752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:35.069397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:45361)
0809 02:29:35.069739 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:35.069803 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":79,"threads_started":1}
I20260809 02:29:35.706156 14753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:35.705622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:41117)
0809 02:29:35.705953 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:35.706028 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":93,"threads_started":1}
I20260809 02:29:35.852110 14755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:35.851607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:40591)
0809 02:29:35.851924 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:35.851993 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":82,"threads_started":1}
I20260809 02:29:36.071208 14756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:36.070780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:32787)
0809 02:29:36.071034 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:36.071092 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":79,"threads_started":1}
I20260809 02:29:36.708747 14757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:36.707036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:40555)
0809 02:29:36.708571 (+ 1535us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:36.708633 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1451,"thread_start_us":1314,"threads_started":1}
I20260809 02:29:36.853631 14759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:36.853132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:42165)
0809 02:29:36.853461 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:36.853527 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":93,"threads_started":1}
I20260809 02:29:37.072467 14761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:37.071995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:42485)
0809 02:29:37.072305 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:37.072367 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":139,"threads_started":1}
I20260809 02:29:37.710086 14762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:37.709638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:48863)
0809 02:29:37.709907 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:37.709961 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":81,"threads_started":1}
I20260809 02:29:37.855039 14763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:37.854607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:53495)
0809 02:29:37.854879 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:37.854940 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":91,"threads_started":1}
I20260809 02:29:38.073659 14764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:38.073253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:53551)
0809 02:29:38.073503 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:38.073561 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":78,"threads_started":1}
I20260809 02:29:38.684468 14765 raft_consensus.cc:482] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:29:38.684628 14765 raft_consensus.cc:504] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:38.685071 14765 leader_election.cc:288] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265), bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589)
W20260809 02:29:38.685899 14165 leader_election.cc:341] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589): Not found: Tablet not found: f72724e4ca0846d48cf74987d5f6353c
W20260809 02:29:38.685993 14166 leader_election.cc:341] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265): Not found: Tablet not found: f72724e4ca0846d48cf74987d5f6353c
I20260809 02:29:38.686117 14166 leader_election.cc:302] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a160f83ae7eb48538c54f55bb3145c02; no voters: 0df857ef80004a2398112b70d2256e37, bb65ade627674f05b00c95a4d3531c4c
I20260809 02:29:38.686318 14765 raft_consensus.cc:2726] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:29:38.712755 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:38.710923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:58783)
0809 02:29:38.712556 (+ 1633us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:38.712626 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1544,"thread_start_us":1445,"threads_started":1}
I20260809 02:29:38.856361 14768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:38.855877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:34035)
0809 02:29:38.856195 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:38.856259 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":77,"threads_started":1}
I20260809 02:29:39.074970 14770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:39.074562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:58073)
0809 02:29:39.074822 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:39.074877 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":91,"threads_started":1}
I20260809 02:29:39.714133 14773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:39.713679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:56269)
0809 02:29:39.713966 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:39.714028 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":83,"threads_started":1}
I20260809 02:29:39.857661 14774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:39.857193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:58359)
0809 02:29:39.857492 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:39.857554 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":79,"threads_started":1}
I20260809 02:29:40.076215 14777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:40.075760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:35687)
0809 02:29:40.076059 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:40.076116 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":107,"threads_started":1}
I20260809 02:29:40.715431 14778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:40.714953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:45561)
0809 02:29:40.715258 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:40.715320 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":82,"threads_started":1}
I20260809 02:29:40.859061 14779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:40.858614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:57381)
0809 02:29:40.858898 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:40.858959 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":95,"threads_started":1}
I20260809 02:29:40.992775 14780 raft_consensus.cc:482] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:29:40.992954 14780 raft_consensus.cc:504] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0df857ef80004a2398112b70d2256e37" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35265 } } peers { permanent_uuid: "bb65ade627674f05b00c95a4d3531c4c" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40589 } } peers { permanent_uuid: "a160f83ae7eb48538c54f55bb3145c02" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 36393 } }
I20260809 02:29:40.993414 14780 leader_election.cc:288] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265), bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589)
W20260809 02:29:40.994153 14166 leader_election.cc:341] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0df857ef80004a2398112b70d2256e37 (127.21.214.130:35265): Not found: Tablet not found: f72724e4ca0846d48cf74987d5f6353c
W20260809 02:29:40.994284 14165 leader_election.cc:341] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bb65ade627674f05b00c95a4d3531c4c (127.21.214.131:40589): Not found: Tablet not found: f72724e4ca0846d48cf74987d5f6353c
I20260809 02:29:40.994388 14165 leader_election.cc:302] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a160f83ae7eb48538c54f55bb3145c02; no voters: 0df857ef80004a2398112b70d2256e37, bb65ade627674f05b00c95a4d3531c4c
I20260809 02:29:40.994592 14780 raft_consensus.cc:2726] T f72724e4ca0846d48cf74987d5f6353c P a160f83ae7eb48538c54f55bb3145c02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 02:29:41.077596 14781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:41.077139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:39271)
0809 02:29:41.077440 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:41.077500 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":85,"threads_started":1}
I20260809 02:29:41.716873 14782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:41.716354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:44627)
0809 02:29:41.716683 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:41.716750 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":99,"threads_started":1}
I20260809 02:29:41.860455 14785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:41.859956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:40025)
0809 02:29:41.860284 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:41.860352 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":107,"threads_started":1}
I20260809 02:29:42.078928 14786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:42.078490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:55811)
0809 02:29:42.078772 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:42.078831 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":92,"threads_started":1}
I20260809 02:29:42.718590 14787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:42.717982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.129:59217)
0809 02:29:42.718331 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:42.718396 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":130,"threads_started":1}
I20260809 02:29:42.862026 14788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:42.861513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.130:51387)
0809 02:29:42.861862 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:42.861925 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":110,"threads_started":1}
I20260809 02:29:43.063807 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 14084
I20260809 02:29:43.080509 14790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:43.080062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:36419 (local address 127.21.214.131:43105)
0809 02:29:43.080339 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:43.080403 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.190:36419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":91,"threads_started":1}
I20260809 02:29:43.082726 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 14333
I20260809 02:29:43.094659 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 14526
2026-08-09T02:29:43Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59704 ms)
[----------] 30 tests from SecurityITest (254823 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:29:43 dist-test-slave-68xk krb5kdc[14793](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:29:43 dist-test-slave-68xk krb5kdc[14793](info): set up 2 sockets
Aug 09 02:29:43 dist-test-slave-68xk krb5kdc[14793](info): commencing operation
krb5kdc: starting...
W20260809 02:29:44.355989 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.006s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:29:44 dist-test-slave-68xk krb5kdc[14793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:29:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:29:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:29:44.489748 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:44079
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:44079
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:44.602054 14813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:44.602356 14813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:44.602451 14813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:44.606482 14813 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:29:44.606559 14813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:44.606613 14813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:44.606671 14813 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:29:44.606706 14813 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:29:44.611963 14813 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:44079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:44079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:44.613061 14813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:44.614109 14813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:44.623274 14822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:44.623302 14826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:44.623380 14821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:44.623668 14813 server_base.cc:1034] running on GCE node
I20260809 02:29:44.624235 14813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:44.625324 14813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:44.626492 14813 hybrid_clock.cc:648] HybridClock initialized: now 1786242584626468 us; error 36 us; skew 500 ppm
Aug 09 02:29:44 dist-test-slave-68xk krb5kdc[14793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242584, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:44.629261 14813 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:29:44.630146 14813 webserver.cc:460] Webserver started at http://127.21.214.190:35377/ using document root <none> and password file <none>
I20260809 02:29:44.630745 14813 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:44.630808 14813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:44.630976 14813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:44.632959 14813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "20f24783edef433fa881e95918c67f8e"
format_stamp: "Formatted at 2026-08-09 02:29:44 on dist-test-slave-68xk"
server_key: "e79b3e167de320fef93173e396e75f42"
server_key_iv: "38f0560deeac18792576825293fd8dcf"
server_key_version: "encryptionkey@0"
I20260809 02:29:44.633471 14813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "20f24783edef433fa881e95918c67f8e"
format_stamp: "Formatted at 2026-08-09 02:29:44 on dist-test-slave-68xk"
server_key: "e79b3e167de320fef93173e396e75f42"
server_key_iv: "38f0560deeac18792576825293fd8dcf"
server_key_version: "encryptionkey@0"
I20260809 02:29:44.637218 14813 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 02:29:44.639659 14836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:44.641033 14813 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:29:44.641181 14813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "20f24783edef433fa881e95918c67f8e"
format_stamp: "Formatted at 2026-08-09 02:29:44 on dist-test-slave-68xk"
server_key: "e79b3e167de320fef93173e396e75f42"
server_key_iv: "38f0560deeac18792576825293fd8dcf"
server_key_version: "encryptionkey@0"
I20260809 02:29:44.641299 14813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:44.665648 14813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:44.669150 14813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:44.669485 14813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:44.677271 14813 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:44079
I20260809 02:29:44.677297 14915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:44079 every 8 connection(s)
I20260809 02:29:44.678247 14813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:29:44.681082 14916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:44.686646 14916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e: Bootstrap starting.
I20260809 02:29:44.686880 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 14813
I20260809 02:29:44.687022 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:29:44.687387 22362 external_mini_cluster.cc:1428] Setting key cdb1143c57c90ad4d31b59c9bccd7568
I20260809 02:29:44.689502 14916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:44.690250 14916 log.cc:824] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:44.692392 14916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e: No bootstrap required, opened a new log
Aug 09 02:29:44 dist-test-slave-68xk krb5kdc[14793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:29:44.696969 14916 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20f24783edef433fa881e95918c67f8e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44079 } }
I20260809 02:29:44.697285 14916 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:44.697340 14916 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20f24783edef433fa881e95918c67f8e, State: Initialized, Role: FOLLOWER
I20260809 02:29:44.697881 14916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20f24783edef433fa881e95918c67f8e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44079 } }
I20260809 02:29:44.698071 14916 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:29:44.698153 14916 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:29:44.698295 14916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:44.699241 14916 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20f24783edef433fa881e95918c67f8e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44079 } }
I20260809 02:29:44.699612 14916 leader_election.cc:302] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20f24783edef433fa881e95918c67f8e; no voters:
I20260809 02:29:44.700007 14916 leader_election.cc:288] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:29:44.700176 14922 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:44.700433 14922 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [term 1 LEADER]: Becoming Leader. State: Replica: 20f24783edef433fa881e95918c67f8e, State: Running, Role: LEADER
I20260809 02:29:44.700744 14922 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20f24783edef433fa881e95918c67f8e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44079 } }
I20260809 02:29:44.701438 14916 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:29:44.701974 14922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20f24783edef433fa881e95918c67f8e. Latest consensus state: current_term: 1 leader_uuid: "20f24783edef433fa881e95918c67f8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20f24783edef433fa881e95918c67f8e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44079 } } }
I20260809 02:29:44.702085 14922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:44.702585 14926 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:29:44.702966 14923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20f24783edef433fa881e95918c67f8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20f24783edef433fa881e95918c67f8e" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44079 } } }
I20260809 02:29:44.703079 14923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:44.703423 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:44.688785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48442 (local address 127.21.214.190:44079)
0809 02:29:44.689196 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:44.689219 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:44.689263 (+ 44us) server_negotiation.cc:407] Connection header received
0809 02:29:44.689952 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:44.689970 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:44.690306 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:44.690700 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:44.691490 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:44.692457 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:44.693622 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:44.694088 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:44.694203 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:44.697158 (+ 2955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:44.697165 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:44.697182 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:44.697224 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:44.699509 (+ 2285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:44.700089 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:44.700095 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:44.700101 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:44.700270 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:44.700644 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:44.700647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:44.700649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:44.701178 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:44.701352 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:44.701941 (+ 589us) server_negotiation.cc:299] Negotiation successful
0809 02:29:44.702279 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":140,"threads_started":1}
I20260809 02:29:44.706251 14926 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:29:44.712041 14926 catalog_manager.cc:1347] Generated new cluster ID: 95ba267ea67740a58fa2d47af01754fd
I20260809 02:29:44.712121 14926 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:29:44.750466 14926 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:29:44.751526 14926 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:29:44.755312 14926 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e: Generated new TSK 0
I20260809 02:29:44.755980 14926 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:29:44.791421 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44079
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:44.920480 14954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:44.920745 14954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:44.920791 14954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:44.924871 14954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:44.924937 14954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:44.925025 14954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:29:44.930241 14954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:44.931358 14954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:44.932421 14954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:44.942276 14961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:44.942314 14965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:44.942301 14962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:44.942768 14954 server_base.cc:1034] running on GCE node
I20260809 02:29:44.943241 14954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:44.943878 14954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:44.945099 14954 hybrid_clock.cc:648] HybridClock initialized: now 1786242584945069 us; error 47 us; skew 500 ppm
Aug 09 02:29:44 dist-test-slave-68xk krb5kdc[14793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242584, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:44.948037 14954 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:29:44.948987 14954 webserver.cc:460] Webserver started at http://127.21.214.129:33589/ using document root <none> and password file <none>
I20260809 02:29:44.949579 14954 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:44.949673 14954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:44.949911 14954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:44.952092 14954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "6b3f3112492f4b35b8954f6cd658a143"
format_stamp: "Formatted at 2026-08-09 02:29:44 on dist-test-slave-68xk"
server_key: "9e045531a8a8230d0f5e5d118abafc21"
server_key_iv: "5a96d7f7986f3897f9449b78728ab876"
server_key_version: "encryptionkey@0"
I20260809 02:29:44.952688 14954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "6b3f3112492f4b35b8954f6cd658a143"
format_stamp: "Formatted at 2026-08-09 02:29:44 on dist-test-slave-68xk"
server_key: "9e045531a8a8230d0f5e5d118abafc21"
server_key_iv: "5a96d7f7986f3897f9449b78728ab876"
server_key_version: "encryptionkey@0"
I20260809 02:29:44.956724 14954 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:29:44.959496 14978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:44.960948 14954 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:29:44.961104 14954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "6b3f3112492f4b35b8954f6cd658a143"
format_stamp: "Formatted at 2026-08-09 02:29:44 on dist-test-slave-68xk"
server_key: "9e045531a8a8230d0f5e5d118abafc21"
server_key_iv: "5a96d7f7986f3897f9449b78728ab876"
server_key_version: "encryptionkey@0"
I20260809 02:29:44.961236 14954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:44.981802 14954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:44.985077 14954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:44.985296 14954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:44.985921 14954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:44.986867 14954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:44.986941 14954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:44.987016 14954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:44.987058 14954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:44.996534 14954 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:35681
I20260809 02:29:44.996569 15153 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:35681 every 8 connection(s)
I20260809 02:29:44.997439 14954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:29:44.999768 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 14954
I20260809 02:29:44.999923 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:29:45.000254 22362 external_mini_cluster.cc:1428] Setting key b42e7f1b828209272574773ba090d60b
Aug 09 02:29:45 dist-test-slave-68xk krb5kdc[14793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242584, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:29:45.015314 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:44.999369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:54625 (local address 127.21.214.190:44079)
0809 02:29:44.999545 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:44.999552 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:45.000510 (+ 958us) server_negotiation.cc:407] Connection header received
0809 02:29:45.002169 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:45.002172 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:45.002227 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:45.002303 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:45.003659 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.004191 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.006142 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.006591 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.006732 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.010431 (+ 3699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:45.010438 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:45.010443 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:45.010472 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:45.012511 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:45.013198 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:45.013204 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:45.013208 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:45.013315 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:45.013781 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:45.013787 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:45.013790 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:45.014103 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:45.014208 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:45.015023 (+ 815us) server_negotiation.cc:299] Negotiation successful
0809 02:29:45.015179 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
I20260809 02:29:45.016297 15158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:44.999765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44079 (local address 127.21.214.129:54625)
0809 02:29:45.000336 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:45.000391 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:45.001931 (+ 1540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:45.002508 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:45.002522 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:45.002928 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:45.003506 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.003521 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.004322 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.004326 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.006007 (+ 1681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.006018 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.006806 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.006813 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.007114 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.007967 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:45.008006 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:45.010176 (+ 2170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:45.012641 (+ 2465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:45.012657 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:45.012677 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:45.013045 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:45.013440 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:45.013444 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:45.013446 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:45.013645 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:45.014236 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:45.014245 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:45.014622 (+ 377us) client_negotiation.cc:769] Sending connection context
0809 02:29:45.014928 (+ 306us) client_negotiation.cc:240] Negotiation successful
0809 02:29:45.015242 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":194,"threads_started":1}
I20260809 02:29:45.017630 15154 heartbeater.cc:347] Connected to a master server at 127.21.214.190:44079
I20260809 02:29:45.017889 15154 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:45.018513 15154 heartbeater.cc:511] Master 127.21.214.190:44079 requested a full tablet report, sending...
I20260809 02:29:45.020133 14860 ts_manager.cc:194] Registered new tserver with Master: 6b3f3112492f4b35b8954f6cd658a143 (127.21.214.129:35681)
I20260809 02:29:45.021348 14860 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:54625
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:29:45.034726 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44079
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:45.151793 15164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:45.152102 15164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:45.152199 15164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:45.156332 15164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:45.156416 15164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:45.156504 15164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:29:45.161883 15164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:45.163087 15164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:45.164143 15164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:45.174430 15171 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:45.174412 15177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:45.174508 15172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:45.174800 15164 server_base.cc:1034] running on GCE node
I20260809 02:29:45.175339 15164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:45.175988 15164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:45.177210 15164 hybrid_clock.cc:648] HybridClock initialized: now 1786242585177191 us; error 31 us; skew 500 ppm
Aug 09 02:29:45 dist-test-slave-68xk krb5kdc[14793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242585, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:45.180154 15164 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:29:45.181095 15164 webserver.cc:460] Webserver started at http://127.21.214.130:36653/ using document root <none> and password file <none>
I20260809 02:29:45.181699 15164 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:45.181797 15164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:45.182041 15164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:45.184190 15164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "9173b600848c4c51bc6016f9030f7ed6"
format_stamp: "Formatted at 2026-08-09 02:29:45 on dist-test-slave-68xk"
server_key: "0945d08251122c26624f7f08f31c5c12"
server_key_iv: "38aacea0f92499347b9669b847c5f0fe"
server_key_version: "encryptionkey@0"
I20260809 02:29:45.184798 15164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "9173b600848c4c51bc6016f9030f7ed6"
format_stamp: "Formatted at 2026-08-09 02:29:45 on dist-test-slave-68xk"
server_key: "0945d08251122c26624f7f08f31c5c12"
server_key_iv: "38aacea0f92499347b9669b847c5f0fe"
server_key_version: "encryptionkey@0"
I20260809 02:29:45.188679 15164 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:29:45.191375 15190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:45.192837 15164 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:29:45.193010 15164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "9173b600848c4c51bc6016f9030f7ed6"
format_stamp: "Formatted at 2026-08-09 02:29:45 on dist-test-slave-68xk"
server_key: "0945d08251122c26624f7f08f31c5c12"
server_key_iv: "38aacea0f92499347b9669b847c5f0fe"
server_key_version: "encryptionkey@0"
I20260809 02:29:45.193152 15164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:45.216089 15164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:45.219195 15164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:45.219411 15164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:45.220021 15164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:45.220890 15164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:45.220963 15164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:45.221036 15164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:45.221092 15164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:45.230890 15164 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:32793
I20260809 02:29:45.230908 15356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:32793 every 8 connection(s)
I20260809 02:29:45.231841 15164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:29:45.232264 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 15164
I20260809 02:29:45.232410 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:29:45.232749 22362 external_mini_cluster.cc:1428] Setting key 236ffaa87b38060c48655522d9367638
Aug 09 02:29:45 dist-test-slave-68xk krb5kdc[14793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242585, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
I20260809 02:29:45.247666 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.233754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:36125 (local address 127.21.214.190:44079)
0809 02:29:45.233884 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:45.233888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:45.235038 (+ 1150us) server_negotiation.cc:407] Connection header received
0809 02:29:45.237027 (+ 1989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:45.237030 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:45.237087 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:45.237165 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:45.238333 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.238929 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.240208 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.240444 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.240552 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.243201 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:45.243204 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:45.243206 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:45.243232 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:45.245031 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:45.245725 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:45.245728 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:45.245729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:45.245838 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:45.246330 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:45.246334 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:45.246335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:45.246595 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:45.246691 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:45.247403 (+ 712us) server_negotiation.cc:299] Negotiation successful
0809 02:29:45.247514 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:29:45.248698 15359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.234247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44079 (local address 127.21.214.130:36125)
0809 02:29:45.234840 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:45.234910 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:45.236772 (+ 1862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:45.237344 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:45.237351 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:45.237702 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:45.238184 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.238197 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.239062 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.239066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.240069 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.240080 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.240609 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.240614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.240799 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.241420 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:45.241436 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:45.243003 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:45.245322 (+ 2319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:45.245330 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:45.245353 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:45.245624 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:45.245952 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:45.245958 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:45.245961 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:45.246160 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:45.246751 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:45.246761 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:45.247103 (+ 342us) client_negotiation.cc:769] Sending connection context
0809 02:29:45.247331 (+ 228us) client_negotiation.cc:240] Negotiation successful
0809 02:29:45.247714 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":177,"threads_started":1}
I20260809 02:29:45.250054 15357 heartbeater.cc:347] Connected to a master server at 127.21.214.190:44079
I20260809 02:29:45.250327 15357 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:45.250856 15357 heartbeater.cc:511] Master 127.21.214.190:44079 requested a full tablet report, sending...
I20260809 02:29:45.252068 14860 ts_manager.cc:194] Registered new tserver with Master: 9173b600848c4c51bc6016f9030f7ed6 (127.21.214.130:32793)
I20260809 02:29:45.252979 14860 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:36125
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:29:45.267073 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44079
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:40245
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:45.384320 15363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:45.384558 15363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:45.384599 15363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:45.389124 15363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:45.389180 15363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:45.389236 15363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:29:45.394212 15363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:40245
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:44079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:45.395205 15363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:45.396210 15363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:45.406527 15370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:45.406571 15369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:45.406719 15363 server_base.cc:1034] running on GCE node
W20260809 02:29:45.406549 15372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:45.407310 15363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:45.407970 15363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:45.409147 15363 hybrid_clock.cc:648] HybridClock initialized: now 1786242585409130 us; error 30 us; skew 500 ppm
Aug 09 02:29:45 dist-test-slave-68xk krb5kdc[14793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242585, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:45.412223 15363 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:29:45.413246 15363 webserver.cc:460] Webserver started at http://127.21.214.131:44349/ using document root <none> and password file <none>
I20260809 02:29:45.413877 15363 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:45.413950 15363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:45.414234 15363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:45.416536 15363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "28a6db411eb540d895e5c0a36af01ccc"
format_stamp: "Formatted at 2026-08-09 02:29:45 on dist-test-slave-68xk"
server_key: "473df41748d77b732b66f82477fcb26c"
server_key_iv: "e620eb3772da21b8c2df2e22cc292ab1"
server_key_version: "encryptionkey@0"
I20260809 02:29:45.417179 15363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "28a6db411eb540d895e5c0a36af01ccc"
format_stamp: "Formatted at 2026-08-09 02:29:45 on dist-test-slave-68xk"
server_key: "473df41748d77b732b66f82477fcb26c"
server_key_iv: "e620eb3772da21b8c2df2e22cc292ab1"
server_key_version: "encryptionkey@0"
I20260809 02:29:45.421330 15363 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260809 02:29:45.424187 15386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:45.425521 15363 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:29:45.425683 15363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "28a6db411eb540d895e5c0a36af01ccc"
format_stamp: "Formatted at 2026-08-09 02:29:45 on dist-test-slave-68xk"
server_key: "473df41748d77b732b66f82477fcb26c"
server_key_iv: "e620eb3772da21b8c2df2e22cc292ab1"
server_key_version: "encryptionkey@0"
I20260809 02:29:45.425806 15363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:45.439921 15363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:45.443001 15363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:45.443274 15363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:45.443928 15363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:45.445025 15363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:45.445125 15363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:45.445173 15363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:45.445199 15363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:45.455615 15363 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:40597
I20260809 02:29:45.455637 15556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:40597 every 8 connection(s)
I20260809 02:29:45.456516 15363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:29:45.464856 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 15363
I20260809 02:29:45.465021 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:29:45.465466 22362 external_mini_cluster.cc:1428] Setting key 6d17de3d62fd5159014cd20e5dd69846
Aug 09 02:29:45 dist-test-slave-68xk krb5kdc[14793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242585, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:29:45.474772 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.458455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:56395 (local address 127.21.214.190:44079)
0809 02:29:45.458644 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:45.458650 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:45.459509 (+ 859us) server_negotiation.cc:407] Connection header received
0809 02:29:45.460788 (+ 1279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:45.460791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:45.460840 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:45.460918 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:45.462091 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.462729 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.464201 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.464419 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.464506 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.471339 (+ 6833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:45.471342 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:45.471344 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:45.471372 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:45.472846 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:45.473363 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:45.473366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:45.473367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:45.473442 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:45.473754 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:45.473756 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:45.473757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:45.473929 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:45.474006 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:45.474556 (+ 550us) server_negotiation.cc:299] Negotiation successful
0809 02:29:45.474653 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 02:29:45.475606 15560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.458864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44079 (local address 127.21.214.131:56395)
0809 02:29:45.459342 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:45.459385 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:45.460576 (+ 1191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:45.461088 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:45.461095 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:45.461471 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:45.461936 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.461949 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.462871 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.462874 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.464043 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.464055 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.464595 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.464604 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.464835 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.469473 (+ 4638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:45.469491 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:45.471165 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:45.472958 (+ 1793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:45.472963 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:45.472976 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:45.473265 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:45.473534 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:45.473537 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:45.473538 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:45.473673 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:45.474019 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:45.474024 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:45.474284 (+ 260us) client_negotiation.cc:769] Sending connection context
0809 02:29:45.474518 (+ 234us) client_negotiation.cc:240] Negotiation successful
0809 02:29:45.474779 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":128,"threads_started":1}
I20260809 02:29:45.476765 15557 heartbeater.cc:347] Connected to a master server at 127.21.214.190:44079
I20260809 02:29:45.477005 15557 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:45.477499 15557 heartbeater.cc:511] Master 127.21.214.190:44079 requested a full tablet report, sending...
I20260809 02:29:45.478855 14857 ts_manager.cc:194] Registered new tserver with Master: 28a6db411eb540d895e5c0a36af01ccc (127.21.214.131:40597)
I20260809 02:29:45.479596 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:29:45.479597 14857 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:56395
I20260809 02:29:45.489533 14920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.481847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48452 (local address 127.21.214.190:44079)
0809 02:29:45.481948 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:45.481951 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:45.482217 (+ 266us) server_negotiation.cc:407] Connection header received
0809 02:29:45.482431 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:45.482437 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:45.482490 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:45.482582 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:45.483276 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.483773 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.484618 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.484841 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.484950 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.486340 (+ 1390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:45.486344 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:45.486346 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:45.486371 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:45.487849 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:45.488276 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:45.488281 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:45.488283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:45.488367 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:45.488651 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:45.488655 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:45.488657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:45.488867 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:45.489013 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:45.489252 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 02:29:45.489364 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 02:29:45.492462 14857 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48452:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:29:45.495424 14857 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:29:45.510356 15576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.504537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:35681 (local address 127.0.0.1:40026)
0809 02:29:45.505505 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:45.505517 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:45.505588 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:45.506295 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:45.506298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:45.506317 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:45.506480 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.506489 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.507480 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.507486 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.508697 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.508707 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.509804 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.509808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.509914 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.509950 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 02:29:45.510088 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 02:29:45.510210 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":906,"mutex_wait_us":49,"thread_start_us":133,"threads_started":1}
I20260809 02:29:45.510365 15583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.505008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40026 (local address 127.21.214.129:35681)
0809 02:29:45.505621 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:45.505640 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:45.505666 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:29:45.505749 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:45.505754 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:45.505947 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:45.506111 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:45.506601 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.507334 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.508830 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.509670 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.509807 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.509945 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:45.510121 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 02:29:45.510211 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":114,"threads_started":1}
I20260809 02:29:45.511160 15582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.504183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:32793 (local address 127.0.0.1:58678)
0809 02:29:45.505308 (+ 1125us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:45.505323 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:45.505395 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:45.506332 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:45.506338 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:45.506365 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:45.506550 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.506557 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.508109 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.508112 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.509483 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.509495 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.510699 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.510704 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.510827 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.510853 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:29:45.510907 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 02:29:45.510980 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"mutex_wait_us":97,"thread_start_us":92,"threads_started":1}
I20260809 02:29:45.511436 15581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.504336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:40597 (local address 127.0.0.1:42898)
0809 02:29:45.505085 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:45.505147 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:45.505276 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:45.506070 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:45.506077 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:45.506122 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:45.506293 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.506306 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.508002 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.508008 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.509366 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.509376 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.510855 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.510859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.510965 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.510989 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 02:29:45.511069 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 02:29:45.511134 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"mutex_wait_us":31,"thread_start_us":93,"threads_started":1}
I20260809 02:29:45.511703 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.505063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42898 (local address 127.21.214.131:40597)
0809 02:29:45.505571 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:45.505585 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:45.505611 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:29:45.505736 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:45.505741 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:45.505901 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:45.506106 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:45.506484 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.507820 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.509502 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.510724 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.510853 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.510984 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:45.511121 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 02:29:45.511237 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":180,"threads_started":1}
I20260809 02:29:45.512202 15578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.504219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58678 (local address 127.21.214.130:32793)
0809 02:29:45.505854 (+ 1635us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:45.505864 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:45.505884 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:29:45.505958 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:45.505964 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:45.506181 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:45.506339 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:45.506721 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.507937 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.509632 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.510534 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.511743 (+ 1209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.511891 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:45.511948 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 02:29:45.512053 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1504,"thread_start_us":157,"threads_started":1}
I20260809 02:29:45.513831 15056 tablet_service.cc:1467] Processing CreateTablet for tablet fdb868c525d448a6995d00e4d0e2e620 (DEFAULT_TABLE table=test-table [id=63a32bca1cc94ab0906d107564e48a1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:45.514480 15462 tablet_service.cc:1467] Processing CreateTablet for tablet fdb868c525d448a6995d00e4d0e2e620 (DEFAULT_TABLE table=test-table [id=63a32bca1cc94ab0906d107564e48a1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:45.515560 15462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdb868c525d448a6995d00e4d0e2e620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:45.516978 15258 tablet_service.cc:1467] Processing CreateTablet for tablet fdb868c525d448a6995d00e4d0e2e620 (DEFAULT_TABLE table=test-table [id=63a32bca1cc94ab0906d107564e48a1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:45.517964 15258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdb868c525d448a6995d00e4d0e2e620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:45.515048 15056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdb868c525d448a6995d00e4d0e2e620. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:45.523312 15588 tablet_bootstrap.cc:492] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc: Bootstrap starting.
I20260809 02:29:45.525092 15590 tablet_bootstrap.cc:492] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6: Bootstrap starting.
I20260809 02:29:45.526068 15588 tablet_bootstrap.cc:654] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:45.526355 15591 tablet_bootstrap.cc:492] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143: Bootstrap starting.
I20260809 02:29:45.527397 15590 tablet_bootstrap.cc:654] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:45.527530 15588 log.cc:824] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:45.528563 15591 tablet_bootstrap.cc:654] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:45.528642 15590 log.cc:824] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:45.529405 15591 log.cc:824] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:45.529706 15588 tablet_bootstrap.cc:492] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc: No bootstrap required, opened a new log
I20260809 02:29:45.529963 15588 ts_tablet_manager.cc:1397] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 02:29:45.530794 15590 tablet_bootstrap.cc:492] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6: No bootstrap required, opened a new log
I20260809 02:29:45.531005 15590 ts_tablet_manager.cc:1397] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:29:45.531599 15591 tablet_bootstrap.cc:492] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143: No bootstrap required, opened a new log
I20260809 02:29:45.531807 15591 ts_tablet_manager.cc:1397] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:29:45.533876 15590 raft_consensus.cc:348] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9173b600848c4c51bc6016f9030f7ed6" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 32793 } } peers { permanent_uuid: "28a6db411eb540d895e5c0a36af01ccc" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40597 } } peers { permanent_uuid: "6b3f3112492f4b35b8954f6cd658a143" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 35681 } }
I20260809 02:29:45.534113 15590 raft_consensus.cc:374] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:45.534169 15590 raft_consensus.cc:729] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9173b600848c4c51bc6016f9030f7ed6, State: Initialized, Role: FOLLOWER
I20260809 02:29:45.534652 15590 consensus_queue.cc:260] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9173b600848c4c51bc6016f9030f7ed6" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 32793 } } peers { permanent_uuid: "28a6db411eb540d895e5c0a36af01ccc" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40597 } } peers { permanent_uuid: "6b3f3112492f4b35b8954f6cd658a143" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 35681 } }
I20260809 02:29:45.534560 15588 raft_consensus.cc:348] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9173b600848c4c51bc6016f9030f7ed6" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 32793 } } peers { permanent_uuid: "28a6db411eb540d895e5c0a36af01ccc" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40597 } } peers { permanent_uuid: "6b3f3112492f4b35b8954f6cd658a143" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 35681 } }
I20260809 02:29:45.534824 15588 raft_consensus.cc:374] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:45.534876 15588 raft_consensus.cc:729] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28a6db411eb540d895e5c0a36af01ccc, State: Initialized, Role: FOLLOWER
I20260809 02:29:45.535377 15588 consensus_queue.cc:260] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9173b600848c4c51bc6016f9030f7ed6" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 32793 } } peers { permanent_uuid: "28a6db411eb540d895e5c0a36af01ccc" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40597 } } peers { permanent_uuid: "6b3f3112492f4b35b8954f6cd658a143" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 35681 } }
I20260809 02:29:45.535743 15590 ts_tablet_manager.cc:1428] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260809 02:29:45.536109 15357 heartbeater.cc:503] Master 127.21.214.190:44079 was elected leader, sending a full tablet report...
I20260809 02:29:45.536109 15557 heartbeater.cc:503] Master 127.21.214.190:44079 was elected leader, sending a full tablet report...
I20260809 02:29:45.536391 15588 ts_tablet_manager.cc:1428] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 02:29:45.536584 15591 raft_consensus.cc:348] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9173b600848c4c51bc6016f9030f7ed6" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 32793 } } peers { permanent_uuid: "28a6db411eb540d895e5c0a36af01ccc" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40597 } } peers { permanent_uuid: "6b3f3112492f4b35b8954f6cd658a143" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 35681 } }
I20260809 02:29:45.536883 15591 raft_consensus.cc:374] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:45.536944 15591 raft_consensus.cc:729] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b3f3112492f4b35b8954f6cd658a143, State: Initialized, Role: FOLLOWER
I20260809 02:29:45.537424 15591 consensus_queue.cc:260] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9173b600848c4c51bc6016f9030f7ed6" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 32793 } } peers { permanent_uuid: "28a6db411eb540d895e5c0a36af01ccc" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40597 } } peers { permanent_uuid: "6b3f3112492f4b35b8954f6cd658a143" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 35681 } }
I20260809 02:29:45.538197 15154 heartbeater.cc:503] Master 127.21.214.190:44079 was elected leader, sending a full tablet report...
I20260809 02:29:45.538479 15591 ts_tablet_manager.cc:1428] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260809 02:29:45.707604 15559 tablet.cc:2369] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:29:45.733212 15358 tablet.cc:2369] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:29:45.748886 15156 tablet.cc:2369] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:29:45.792217 15598 raft_consensus.cc:482] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:29:45.792517 15598 raft_consensus.cc:504] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9173b600848c4c51bc6016f9030f7ed6" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 32793 } } peers { permanent_uuid: "28a6db411eb540d895e5c0a36af01ccc" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40597 } } peers { permanent_uuid: "6b3f3112492f4b35b8954f6cd658a143" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 35681 } }
I20260809 02:29:45.793839 15598 leader_election.cc:288] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9173b600848c4c51bc6016f9030f7ed6 (127.21.214.130:32793), 6b3f3112492f4b35b8954f6cd658a143 (127.21.214.129:35681)
I20260809 02:29:45.798249 15560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.794052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:32793 (local address 127.21.214.131:47021)
0809 02:29:45.794189 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:45.794208 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:45.794340 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:45.794736 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:45.794740 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:45.794758 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:45.794890 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.794897 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.795878 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.795884 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.797093 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.797103 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.797794 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.797797 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.797906 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.797932 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 02:29:45.798015 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 02:29:45.798106 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 02:29:45.798259 15578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.794224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:47021 (local address 127.21.214.130:32793)
0809 02:29:45.794431 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:45.794438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:45.794458 (+ 20us) server_negotiation.cc:407] Connection header received
0809 02:29:45.794526 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:45.794529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:45.794598 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:45.794702 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:45.795019 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.795763 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.797212 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.797663 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.797819 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.797864 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:45.798039 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 02:29:45.798130 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 02:29:45.798671 15583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.794898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:47507 (local address 127.21.214.129:35681)
0809 02:29:45.795078 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:45.795083 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:45.795096 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:29:45.795146 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:45.795149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:45.795211 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:45.795287 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:45.795671 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.796149 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.797481 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.798021 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.798129 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.798186 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:45.798465 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 02:29:45.798552 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260809 02:29:45.799029 15600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.794236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:35681 (local address 127.21.214.131:47507)
0809 02:29:45.794604 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:45.794619 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:45.794709 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:45.795394 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:45.795397 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:45.795414 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:45.795536 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.795550 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.796271 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.796274 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.797345 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:45.797353 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.798137 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.798140 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:45.798262 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.798295 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 02:29:45.798842 (+ 547us) client_negotiation.cc:240] Negotiation successful
0809 02:29:45.798923 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":192,"threads_started":1}
I20260809 02:29:45.798995 15289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb868c525d448a6995d00e4d0e2e620" candidate_uuid: "28a6db411eb540d895e5c0a36af01ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9173b600848c4c51bc6016f9030f7ed6" is_pre_election: true
I20260809 02:29:45.799343 15289 raft_consensus.cc:2454] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28a6db411eb540d895e5c0a36af01ccc in term 0.
I20260809 02:29:45.799686 15087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb868c525d448a6995d00e4d0e2e620" candidate_uuid: "28a6db411eb540d895e5c0a36af01ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3f3112492f4b35b8954f6cd658a143" is_pre_election: true
I20260809 02:29:45.799888 15390 leader_election.cc:302] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a6db411eb540d895e5c0a36af01ccc, 9173b600848c4c51bc6016f9030f7ed6; no voters:
I20260809 02:29:45.800009 15087 raft_consensus.cc:2454] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28a6db411eb540d895e5c0a36af01ccc in term 0.
I20260809 02:29:45.800213 15598 raft_consensus.cc:2781] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:29:45.800325 15598 raft_consensus.cc:482] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:29:45.800380 15598 raft_consensus.cc:3037] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:45.801678 15598 raft_consensus.cc:504] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9173b600848c4c51bc6016f9030f7ed6" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 32793 } } peers { permanent_uuid: "28a6db411eb540d895e5c0a36af01ccc" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40597 } } peers { permanent_uuid: "6b3f3112492f4b35b8954f6cd658a143" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 35681 } }
I20260809 02:29:45.802011 15598 leader_election.cc:288] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [CANDIDATE]: Term 1 election: Requested vote from peers 9173b600848c4c51bc6016f9030f7ed6 (127.21.214.130:32793), 6b3f3112492f4b35b8954f6cd658a143 (127.21.214.129:35681)
I20260809 02:29:45.802474 15087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb868c525d448a6995d00e4d0e2e620" candidate_uuid: "28a6db411eb540d895e5c0a36af01ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b3f3112492f4b35b8954f6cd658a143"
I20260809 02:29:45.802438 15289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdb868c525d448a6995d00e4d0e2e620" candidate_uuid: "28a6db411eb540d895e5c0a36af01ccc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9173b600848c4c51bc6016f9030f7ed6"
I20260809 02:29:45.802619 15087 raft_consensus.cc:3037] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:45.802619 15289 raft_consensus.cc:3037] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:45.803822 15087 raft_consensus.cc:2454] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a6db411eb540d895e5c0a36af01ccc in term 1.
I20260809 02:29:45.803853 15289 raft_consensus.cc:2454] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28a6db411eb540d895e5c0a36af01ccc in term 1.
I20260809 02:29:45.804194 15387 leader_election.cc:302] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28a6db411eb540d895e5c0a36af01ccc, 6b3f3112492f4b35b8954f6cd658a143; no voters:
I20260809 02:29:45.804402 15598 raft_consensus.cc:2781] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:45.804579 15598 raft_consensus.cc:686] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [term 1 LEADER]: Becoming Leader. State: Replica: 28a6db411eb540d895e5c0a36af01ccc, State: Running, Role: LEADER
I20260809 02:29:45.804919 15598 consensus_queue.cc:237] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9173b600848c4c51bc6016f9030f7ed6" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 32793 } } peers { permanent_uuid: "28a6db411eb540d895e5c0a36af01ccc" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40597 } } peers { permanent_uuid: "6b3f3112492f4b35b8954f6cd658a143" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 35681 } }
I20260809 02:29:45.808035 14860 catalog_manager.cc:5495] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc reported cstate change: term changed from 0 to 1, leader changed from <none> to 28a6db411eb540d895e5c0a36af01ccc (127.21.214.131). New cstate: current_term: 1 leader_uuid: "28a6db411eb540d895e5c0a36af01ccc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9173b600848c4c51bc6016f9030f7ed6" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28a6db411eb540d895e5c0a36af01ccc" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 40597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b3f3112492f4b35b8954f6cd658a143" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 35681 } health_report { overall_health: UNKNOWN } } }
I20260809 02:29:45.875289 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.871685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42900 (local address 127.21.214.131:40597)
0809 02:29:45.871844 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:45.871848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:45.871863 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:29:45.871946 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:45.871948 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:45.872009 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:45.872105 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:29:45.872350 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.872913 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.873772 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:45.874002 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:45.874089 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:45.874382 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:29:45.874856 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:29:45.874955 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:45.875013 (+ 58us) server_negotiation.cc:299] Negotiation successful
0809 02:29:45.875066 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 02:29:45.881615 15087 raft_consensus.cc:1261] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143 [term 1 FOLLOWER]: Refusing update from remote peer 28a6db411eb540d895e5c0a36af01ccc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:45.881615 15289 raft_consensus.cc:1261] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6 [term 1 FOLLOWER]: Refusing update from remote peer 28a6db411eb540d895e5c0a36af01ccc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:45.882510 15598 consensus_queue.cc:1035] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b3f3112492f4b35b8954f6cd658a143" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 35681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:45.882740 15601 consensus_queue.cc:1035] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9173b600848c4c51bc6016f9030f7ed6" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:45.890494 15608 mvcc.cc:205] Tried to move back new op lower bound from 7316449631762931712 to 7316449631459606528. Current Snapshot: MvccSnapshot[applied={T|T < 7316449631762931712}]
I20260809 02:29:45.891389 15610 mvcc.cc:205] Tried to move back new op lower bound from 7316449631762931712 to 7316449631459606528. Current Snapshot: MvccSnapshot[applied={T|T < 7316449631762931712}]
I20260809 02:29:45.891614 15607 mvcc.cc:205] Tried to move back new op lower bound from 7316449631762931712 to 7316449631459606528. Current Snapshot: MvccSnapshot[applied={T|T < 7316449631762931712}]
I20260809 02:29:45.900243 14860 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:45.900432 14860 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48452:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:45.903177 14860 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 20f24783edef433fa881e95918c67f8e: Sending DeleteTablet for 3 replicas of tablet fdb868c525d448a6995d00e4d0e2e620
I20260809 02:29:45.904011 15462 tablet_service.cc:1514] Processing DeleteTablet for tablet fdb868c525d448a6995d00e4d0e2e620 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:45 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:42898
I20260809 02:29:45.904017 15258 tablet_service.cc:1514] Processing DeleteTablet for tablet fdb868c525d448a6995d00e4d0e2e620 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:45 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:58678
I20260809 02:29:45.904572 15620 tablet_replica.cc:330] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc: stopping tablet replica
I20260809 02:29:45.904574 15056 tablet_service.cc:1514] Processing DeleteTablet for tablet fdb868c525d448a6995d00e4d0e2e620 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:45 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:40026
I20260809 02:29:45.904894 15620 raft_consensus.cc:2229] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:29:45.905128 15621 tablet_replica.cc:330] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143: stopping tablet replica
I20260809 02:29:45.905318 15620 raft_consensus.cc:2258] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:45.905546 15621 raft_consensus.cc:2229] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:29:45.905717 15619 tablet_replica.cc:330] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6: stopping tablet replica
I20260809 02:29:45.905985 15621 raft_consensus.cc:2258] T fdb868c525d448a6995d00e4d0e2e620 P 6b3f3112492f4b35b8954f6cd658a143 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:45.906028 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 14954
I20260809 02:29:45.906031 15619 raft_consensus.cc:2229] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:29:45.906342 15619 raft_consensus.cc:2258] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:45.909409 15619 ts_tablet_manager.cc:1905] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:45.912391 15619 ts_tablet_manager.cc:1918] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:45.912501 15619 log.cc:1196] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/fdb868c525d448a6995d00e4d0e2e620
I20260809 02:29:45.912835 15619 ts_tablet_manager.cc:1939] T fdb868c525d448a6995d00e4d0e2e620 P 9173b600848c4c51bc6016f9030f7ed6: Deleting consensus metadata
I20260809 02:29:45.914160 14840 catalog_manager.cc:4841] TS 9173b600848c4c51bc6016f9030f7ed6 (127.21.214.130:32793): tablet fdb868c525d448a6995d00e4d0e2e620 (table test-table [id=63a32bca1cc94ab0906d107564e48a1c]) successfully deleted
I20260809 02:29:45.918917 15620 ts_tablet_manager.cc:1905] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 02:29:45.919919 14837 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:35681 (error 108)
I20260809 02:29:45.920265 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 15164
I20260809 02:29:45.922822 15576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:45.920850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:35681 (local address 127.0.0.1:40042)
0809 02:29:45.922619 (+ 1769us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:45.922710 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:35681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1476}
W20260809 02:29:45.922994 14837 catalog_manager.cc:4584] TS 6b3f3112492f4b35b8954f6cd658a143 (127.21.214.129:35681): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fdb868c525d448a6995d00e4d0e2e620: Network error: Client connection negotiation failed: client connection to 127.21.214.129:35681: connect: Connection refused (error 111)
I20260809 02:29:45.923384 15620 ts_tablet_manager.cc:1918] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:45.923475 15620 log.cc:1196] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/fdb868c525d448a6995d00e4d0e2e620
I20260809 02:29:45.923804 15620 ts_tablet_manager.cc:1939] T fdb868c525d448a6995d00e4d0e2e620 P 28a6db411eb540d895e5c0a36af01ccc: Deleting consensus metadata
I20260809 02:29:45.925052 14838 catalog_manager.cc:4841] TS 28a6db411eb540d895e5c0a36af01ccc (127.21.214.131:40597): tablet fdb868c525d448a6995d00e4d0e2e620 (table test-table [id=63a32bca1cc94ab0906d107564e48a1c]) successfully deleted
I20260809 02:29:45.934511 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 15363
I20260809 02:29:45.944509 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 14813
2026-08-09T02:29:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2848 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T02:29:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:29:45Z Disabled control of system clock
I20260809 02:29:45.984511 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:33219
--webserver_interface=127.21.214.190
--webserver_port=0
--builtin_ntp_servers=127.21.214.148:33905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:33219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:29:46.096707 15630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:46.096967 15630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:46.097003 15630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:46.100977 15630 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:29:46.101033 15630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:46.101051 15630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:46.101068 15630 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:29:46.101083 15630 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:29:46.105654 15630 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:33905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:33219
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:33219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:46.106736 15630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:46.108078 15630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:46.116914 15639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:46.116951 15630 server_base.cc:1034] running on GCE node
W20260809 02:29:46.116914 15642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:46.116935 15644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:46.117774 15630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:46.119019 15630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:46.120246 15630 hybrid_clock.cc:648] HybridClock initialized: now 1786242586120232 us; error 31 us; skew 500 ppm
I20260809 02:29:46.122293 15630 webserver.cc:460] Webserver started at http://127.21.214.190:43971/ using document root <none> and password file <none>
I20260809 02:29:46.122969 15630 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:46.123086 15630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:46.123346 15630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:46.125541 15630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "cfe6373fd94f474bb77a329d9aa8ad7a"
format_stamp: "Formatted at 2026-08-09 02:29:46 on dist-test-slave-68xk"
server_key: "85544989ac2ace27ae03cbd965f4ed4a"
server_key_iv: "9a3b4e6eb92fbe20ec3c6e1f3416f389"
server_key_version: "encryptionkey@0"
I20260809 02:29:46.126160 15630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "cfe6373fd94f474bb77a329d9aa8ad7a"
format_stamp: "Formatted at 2026-08-09 02:29:46 on dist-test-slave-68xk"
server_key: "85544989ac2ace27ae03cbd965f4ed4a"
server_key_iv: "9a3b4e6eb92fbe20ec3c6e1f3416f389"
server_key_version: "encryptionkey@0"
I20260809 02:29:46.130133 15630 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 02:29:46.132776 15653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:46.133992 15630 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:29:46.134193 15630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "cfe6373fd94f474bb77a329d9aa8ad7a"
format_stamp: "Formatted at 2026-08-09 02:29:46 on dist-test-slave-68xk"
server_key: "85544989ac2ace27ae03cbd965f4ed4a"
server_key_iv: "9a3b4e6eb92fbe20ec3c6e1f3416f389"
server_key_version: "encryptionkey@0"
I20260809 02:29:46.134316 15630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:46.148182 15630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:46.148878 15630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:46.149101 15630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:46.156483 15630 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:33219
I20260809 02:29:46.156507 15725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:33219 every 8 connection(s)
I20260809 02:29:46.157471 15630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:29:46.160610 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 15630
I20260809 02:29:46.160778 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:29:46.160844 15726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:46.161151 22362 external_mini_cluster.cc:1428] Setting key af7e63a38600e40d8429e1f34fdec760
I20260809 02:29:46.168236 15726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a: Bootstrap starting.
I20260809 02:29:46.170923 15726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:46.171844 15726 log.cc:824] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:46.172287 15731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.162681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44782 (local address 127.21.214.190:33219)
0809 02:29:46.163340 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:46.163360 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:46.163403 (+ 43us) server_negotiation.cc:407] Connection header received
0809 02:29:46.164455 (+ 1052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:46.164479 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:46.164988 (+ 509us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:46.165395 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:46.165836 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.167354 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.168345 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.169020 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.169189 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.170103 (+ 914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:46.170110 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:46.170124 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:46.170651 (+ 527us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:46.170720 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:46.170749 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:46.170857 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:46.171046 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 02:29:46.171335 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":124,"threads_started":1}
I20260809 02:29:46.174059 15726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a: No bootstrap required, opened a new log
I20260809 02:29:46.177709 15726 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe6373fd94f474bb77a329d9aa8ad7a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33219 } }
I20260809 02:29:46.177938 15726 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:46.178033 15726 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe6373fd94f474bb77a329d9aa8ad7a, State: Initialized, Role: FOLLOWER
I20260809 02:29:46.178491 15726 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe6373fd94f474bb77a329d9aa8ad7a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33219 } }
I20260809 02:29:46.178644 15726 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:29:46.178730 15726 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:29:46.178828 15726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:46.179708 15726 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe6373fd94f474bb77a329d9aa8ad7a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33219 } }
I20260809 02:29:46.180039 15726 leader_election.cc:302] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfe6373fd94f474bb77a329d9aa8ad7a; no voters:
I20260809 02:29:46.180405 15726 leader_election.cc:288] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:29:46.180476 15733 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:46.180696 15733 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [term 1 LEADER]: Becoming Leader. State: Replica: cfe6373fd94f474bb77a329d9aa8ad7a, State: Running, Role: LEADER
I20260809 02:29:46.180994 15733 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe6373fd94f474bb77a329d9aa8ad7a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33219 } }
I20260809 02:29:46.181681 15726 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:29:46.182834 15735 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfe6373fd94f474bb77a329d9aa8ad7a. Latest consensus state: current_term: 1 leader_uuid: "cfe6373fd94f474bb77a329d9aa8ad7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe6373fd94f474bb77a329d9aa8ad7a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33219 } } }
I20260809 02:29:46.182987 15735 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:46.183341 15734 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfe6373fd94f474bb77a329d9aa8ad7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe6373fd94f474bb77a329d9aa8ad7a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33219 } } }
I20260809 02:29:46.183423 15745 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:29:46.183441 15734 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:46.186700 15745 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:29:46.192481 15745 catalog_manager.cc:1347] Generated new cluster ID: 5f5353431c6c457f9b5b4c3a8ce5d394
I20260809 02:29:46.192554 15745 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:29:46.208662 15745 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:29:46.209807 15745 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:29:46.215353 15745 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a: Generated new TSK 0
I20260809 02:29:46.216148 15745 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:29:46.222956 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33219
--builtin_ntp_servers=127.21.214.148:33905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:29:46.337708 15759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:46.337957 15759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:46.337996 15759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:46.342172 15759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:46.342224 15759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:46.342276 15759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:29:46.347113 15759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:33905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:46.348131 15759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:46.349514 15759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:46.359377 15766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:46.359483 15759 server_base.cc:1034] running on GCE node
W20260809 02:29:46.359411 15767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:46.359426 15769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:46.359980 15759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:46.360637 15759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:46.361812 15759 hybrid_clock.cc:648] HybridClock initialized: now 1786242586361783 us; error 40 us; skew 500 ppm
I20260809 02:29:46.363668 15759 webserver.cc:460] Webserver started at http://127.21.214.129:37211/ using document root <none> and password file <none>
I20260809 02:29:46.364189 15759 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:46.364250 15759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:46.364409 15759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:46.366354 15759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "50215cbf0a6b4adebb9c301996226732"
format_stamp: "Formatted at 2026-08-09 02:29:46 on dist-test-slave-68xk"
server_key: "cf670b0dec380c643d54e78bc848eb66"
server_key_iv: "bca97e0ba10b8aa5593714e98ec51450"
server_key_version: "encryptionkey@0"
I20260809 02:29:46.366940 15759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "50215cbf0a6b4adebb9c301996226732"
format_stamp: "Formatted at 2026-08-09 02:29:46 on dist-test-slave-68xk"
server_key: "cf670b0dec380c643d54e78bc848eb66"
server_key_iv: "bca97e0ba10b8aa5593714e98ec51450"
server_key_version: "encryptionkey@0"
I20260809 02:29:46.370651 15759 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:29:46.373015 15777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:46.374370 15759 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:29:46.374583 15759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "50215cbf0a6b4adebb9c301996226732"
format_stamp: "Formatted at 2026-08-09 02:29:46 on dist-test-slave-68xk"
server_key: "cf670b0dec380c643d54e78bc848eb66"
server_key_iv: "bca97e0ba10b8aa5593714e98ec51450"
server_key_version: "encryptionkey@0"
I20260809 02:29:46.374722 15759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:46.401701 15759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:46.402493 15759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:46.402714 15759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:46.403362 15759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:46.404376 15759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:46.404456 15759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:46.404536 15759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:46.404585 15759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:46.414173 15759 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:39433
I20260809 02:29:46.414220 15948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:39433 every 8 connection(s)
I20260809 02:29:46.415246 15759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:29:46.420908 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 15759
I20260809 02:29:46.421062 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:29:46.421442 22362 external_mini_cluster.cc:1428] Setting key e54d2127c612264e177ecda1e262c14c
I20260809 02:29:46.423694 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33219
--builtin_ntp_servers=127.21.214.148:33905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:29:46.426509 15731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.417223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:36167 (local address 127.21.214.190:33219)
0809 02:29:46.417380 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:46.417385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:46.418588 (+ 1203us) server_negotiation.cc:407] Connection header received
0809 02:29:46.420101 (+ 1513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:46.420104 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:46.420154 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:46.420238 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:46.421539 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.422193 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.423945 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.424301 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.424398 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.425890 (+ 1492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:46.425896 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:46.425901 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:46.425917 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:46.425945 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:46.425957 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:46.426043 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:46.426218 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 02:29:46.426291 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 02:29:46.427326 15951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.417615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:33219 (local address 127.21.214.129:36167)
0809 02:29:46.418356 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:46.418400 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:46.419895 (+ 1495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:46.420394 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:46.420401 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:46.420487 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:46.421346 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.421370 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.422395 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.422398 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.423788 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.423803 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.424622 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.424629 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.424858 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.425541 (+ 683us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:29:46.425545 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:46.425614 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:29:46.425707 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:46.426059 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:46.426067 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:46.426071 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:29:46.426190 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 02:29:46.426460 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":109,"threads_started":1}
I20260809 02:29:46.428541 15949 heartbeater.cc:347] Connected to a master server at 127.21.214.190:33219
I20260809 02:29:46.428825 15949 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:46.429347 15949 heartbeater.cc:511] Master 127.21.214.190:33219 requested a full tablet report, sending...
I20260809 02:29:46.430864 15679 ts_manager.cc:194] Registered new tserver with Master: 50215cbf0a6b4adebb9c301996226732 (127.21.214.129:39433)
I20260809 02:29:46.431982 15679 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.214.129:36167
W20260809 02:29:46.537705 15952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:46.537938 15952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:46.538026 15952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:46.542053 15952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:46.542101 15952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:46.542153 15952 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:29:46.546685 15952 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:33905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:46.547691 15952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:46.548960 15952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:46.559274 15959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:46.559358 15952 server_base.cc:1034] running on GCE node
W20260809 02:29:46.559289 15964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:46.559286 15958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:46.559998 15952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:46.560592 15952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:46.561756 15952 hybrid_clock.cc:648] HybridClock initialized: now 1786242586561731 us; error 38 us; skew 500 ppm
I20260809 02:29:46.563642 15952 webserver.cc:460] Webserver started at http://127.21.214.130:42927/ using document root <none> and password file <none>
I20260809 02:29:46.564245 15952 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:46.564311 15952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:46.564520 15952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:46.566598 15952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "1e443d685d8b41e2a1ec43aef82a240a"
format_stamp: "Formatted at 2026-08-09 02:29:46 on dist-test-slave-68xk"
server_key: "5b970049a6ce6f57d8356519122d7aa6"
server_key_iv: "deb95794be67775a011e5b524480d4c5"
server_key_version: "encryptionkey@0"
I20260809 02:29:46.567150 15952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "1e443d685d8b41e2a1ec43aef82a240a"
format_stamp: "Formatted at 2026-08-09 02:29:46 on dist-test-slave-68xk"
server_key: "5b970049a6ce6f57d8356519122d7aa6"
server_key_iv: "deb95794be67775a011e5b524480d4c5"
server_key_version: "encryptionkey@0"
I20260809 02:29:46.570849 15952 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:29:46.573282 15971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:46.574646 15952 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:29:46.574786 15952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "1e443d685d8b41e2a1ec43aef82a240a"
format_stamp: "Formatted at 2026-08-09 02:29:46 on dist-test-slave-68xk"
server_key: "5b970049a6ce6f57d8356519122d7aa6"
server_key_iv: "deb95794be67775a011e5b524480d4c5"
server_key_version: "encryptionkey@0"
I20260809 02:29:46.574896 15952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:46.591866 15952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:46.592576 15952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:46.592780 15952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:46.593374 15952 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:46.594321 15952 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:46.594394 15952 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:46.594494 15952 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:46.594549 15952 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:46.604060 15952 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:38891
I20260809 02:29:46.604092 16131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:38891 every 8 connection(s)
I20260809 02:29:46.604970 15952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:29:46.611847 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 15952
I20260809 02:29:46.611950 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:29:46.612288 22362 external_mini_cluster.cc:1428] Setting key 71bd2a638ce4457df21f4f333807508c
I20260809 02:29:46.614477 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33219
--builtin_ntp_servers=127.21.214.148:33905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:29:46.614836 15731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.606940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:36471 (local address 127.21.214.190:33219)
0809 02:29:46.607078 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:46.607082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:46.608204 (+ 1122us) server_negotiation.cc:407] Connection header received
0809 02:29:46.609576 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:46.609578 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:46.609628 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:46.609710 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:46.610705 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.611342 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.612689 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.612917 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.613045 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.614200 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:46.614204 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:46.614209 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:46.614227 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:46.614254 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:46.614268 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:46.614355 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:46.614561 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 02:29:46.614633 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:29:46.615666 16134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.607328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:33219 (local address 127.21.214.130:36471)
0809 02:29:46.607998 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:46.608047 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:46.609339 (+ 1292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:46.609885 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:46.609891 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:46.609971 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:46.610520 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.610536 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.611501 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.611504 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.612551 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.612563 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.613102 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.613106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.613279 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.613917 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:29:46.613919 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:46.613959 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:29:46.614022 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:46.614363 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:46.614370 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:46.614375 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 02:29:46.614526 (+ 151us) client_negotiation.cc:240] Negotiation successful
0809 02:29:46.614835 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":123,"threads_started":1}
I20260809 02:29:46.616968 16132 heartbeater.cc:347] Connected to a master server at 127.21.214.190:33219
I20260809 02:29:46.617249 16132 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:46.617765 16132 heartbeater.cc:511] Master 127.21.214.190:33219 requested a full tablet report, sending...
I20260809 02:29:46.618860 15679 ts_manager.cc:194] Registered new tserver with Master: 1e443d685d8b41e2a1ec43aef82a240a (127.21.214.130:38891)
I20260809 02:29:46.619429 15679 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.214.130:36471
W20260809 02:29:46.731999 16135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:46.732249 16135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:46.732286 16135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:46.736212 16135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:46.736261 16135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:46.736313 16135 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:29:46.741001 16135 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:33905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16135
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:46.742063 16135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:46.743433 16135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:46.753005 16146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:46.752977 16143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:46.753008 16142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:46.753324 16135 server_base.cc:1034] running on GCE node
I20260809 02:29:46.753768 16135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:46.754391 16135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:46.755615 16135 hybrid_clock.cc:648] HybridClock initialized: now 1786242586755584 us; error 44 us; skew 500 ppm
I20260809 02:29:46.757510 16135 webserver.cc:460] Webserver started at http://127.21.214.131:37941/ using document root <none> and password file <none>
I20260809 02:29:46.758075 16135 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:46.758139 16135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:46.758404 16135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:46.760514 16135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "3fe3680565e740ca898761b105ec26df"
format_stamp: "Formatted at 2026-08-09 02:29:46 on dist-test-slave-68xk"
server_key: "82b234c95738467e4c20dac8f7b78c3c"
server_key_iv: "3f060e0e9270b2f9d6944cd2bd4a0202"
server_key_version: "encryptionkey@0"
I20260809 02:29:46.761076 16135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "3fe3680565e740ca898761b105ec26df"
format_stamp: "Formatted at 2026-08-09 02:29:46 on dist-test-slave-68xk"
server_key: "82b234c95738467e4c20dac8f7b78c3c"
server_key_iv: "3f060e0e9270b2f9d6944cd2bd4a0202"
server_key_version: "encryptionkey@0"
I20260809 02:29:46.764853 16135 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260809 02:29:46.767379 16153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:46.768677 16135 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260809 02:29:46.768831 16135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "3fe3680565e740ca898761b105ec26df"
format_stamp: "Formatted at 2026-08-09 02:29:46 on dist-test-slave-68xk"
server_key: "82b234c95738467e4c20dac8f7b78c3c"
server_key_iv: "3f060e0e9270b2f9d6944cd2bd4a0202"
server_key_version: "encryptionkey@0"
I20260809 02:29:46.768937 16135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:46.786897 16135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:46.787597 16135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:46.787801 16135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:46.788416 16135 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:46.789373 16135 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:46.789422 16135 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:46.789462 16135 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:46.789477 16135 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:46.799367 16135 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:36039
I20260809 02:29:46.799394 16307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:36039 every 8 connection(s)
I20260809 02:29:46.800263 16135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:29:46.802901 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 16135
I20260809 02:29:46.803009 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:29:46.803298 22362 external_mini_cluster.cc:1428] Setting key a8981ee37d126c54660af0e2dd9da616
I20260809 02:29:46.809629 15731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.802096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:56949 (local address 127.21.214.190:33219)
0809 02:29:46.802236 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:46.802240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:46.803430 (+ 1190us) server_negotiation.cc:407] Connection header received
0809 02:29:46.804873 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:46.804876 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:46.804930 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:46.805048 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:46.806016 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.806576 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.807718 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.807947 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.808062 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.809106 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:46.809110 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:46.809115 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:46.809132 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:46.809150 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:46.809157 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:46.809259 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:46.809421 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 02:29:46.809481 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:29:46.810503 16310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.802462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:33219 (local address 127.21.214.131:56949)
0809 02:29:46.803267 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:46.803308 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:46.804664 (+ 1356us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:46.805252 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:46.805262 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:46.805369 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:46.805878 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.805892 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.806713 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.806717 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.807590 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.807599 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.808102 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.808107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.808281 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.808833 (+ 552us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:29:46.808835 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:46.808874 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:29:46.808933 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:46.809264 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:46.809275 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:46.809281 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 02:29:46.809421 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 02:29:46.809694 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":190,"threads_started":1}
I20260809 02:29:46.811527 16308 heartbeater.cc:347] Connected to a master server at 127.21.214.190:33219
I20260809 02:29:46.811736 16308 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:46.812178 16308 heartbeater.cc:511] Master 127.21.214.190:33219 requested a full tablet report, sending...
I20260809 02:29:46.813100 15679 ts_manager.cc:194] Registered new tserver with Master: 3fe3680565e740ca898761b105ec26df (127.21.214.131:36039)
I20260809 02:29:46.813614 15679 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.214.131:56949
I20260809 02:29:46.817098 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:29:46.822985 15731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.819099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44786 (local address 127.21.214.190:33219)
0809 02:29:46.819291 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:46.819295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:46.819441 (+ 146us) server_negotiation.cc:407] Connection header received
0809 02:29:46.819589 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:46.819592 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:46.819645 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:46.819730 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:46.820042 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.820537 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.821395 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.821608 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.821717 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.822527 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:46.822531 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:46.822535 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:46.822552 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:46.822570 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:46.822577 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:46.822660 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:46.822800 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 02:29:46.822853 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 02:29:46.825917 15679 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:29:46.828912 15679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:29:46.844291 16328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.837602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45836 (local address 127.21.214.130:38891)
0809 02:29:46.838074 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:46.838087 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:46.838507 (+ 420us) server_negotiation.cc:407] Connection header received
0809 02:29:46.838669 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:46.838676 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:46.838897 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:46.839057 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:46.839532 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.840813 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.842858 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.843462 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.843628 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.843819 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:46.843980 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 02:29:46.844104 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":155,"threads_started":1}
I20260809 02:29:46.844285 16332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.837304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:38891 (local address 127.0.0.1:45836)
0809 02:29:46.838388 (+ 1084us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:46.838400 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:46.838517 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:46.839252 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:46.839258 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:46.839288 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:46.839399 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.839404 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.840968 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.840972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.842697 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.842708 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.843642 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.843646 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.843765 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.843810 (+ 45us) client_negotiation.cc:769] Sending connection context
0809 02:29:46.843945 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 02:29:46.844092 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1019,"mutex_wait_us":881,"thread_start_us":92,"threads_started":1}
I20260809 02:29:46.844607 16335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.837692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:39433 (local address 127.0.0.1:32978)
0809 02:29:46.838245 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:46.838311 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:46.838542 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:46.839674 (+ 1132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:46.839678 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:46.839698 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:46.839826 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.839832 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.841016 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.841019 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.842643 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.842656 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.843891 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.843895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.844053 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.844117 (+ 64us) client_negotiation.cc:769] Sending connection context
0809 02:29:46.844181 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 02:29:46.844272 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"mutex_wait_us":35,"thread_start_us":124,"threads_started":1}
I20260809 02:29:46.844899 16336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.838250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32978 (local address 127.21.214.129:39433)
0809 02:29:46.839095 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:46.839108 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:46.839131 (+ 23us) server_negotiation.cc:407] Connection header received
0809 02:29:46.839318 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:46.839324 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:46.839509 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:46.839673 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:46.839957 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.840843 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.842792 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.843514 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.843621 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.843819 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:46.844351 (+ 532us) server_negotiation.cc:299] Negotiation successful
0809 02:29:46.844603 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":742,"thread_start_us":162,"threads_started":1}
I20260809 02:29:46.845269 16326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.837304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:36039 (local address 127.0.0.1:49540)
0809 02:29:46.838200 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:46.838797 (+ 597us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:46.838887 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:46.839750 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:46.839754 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:46.839773 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:46.839963 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.839971 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.841310 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.841313 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.842498 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.842516 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.843891 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.843895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.844057 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.844106 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 02:29:46.844181 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 02:29:46.845142 (+ 961us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"mutex_wait_us":1017,"thread_start_us":92,"threads_started":1}
I20260809 02:29:46.845453 16327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.837500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49540 (local address 127.21.214.131:36039)
0809 02:29:46.838838 (+ 1338us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:46.838850 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:46.838876 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:29:46.839137 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:46.839144 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:46.839384 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:46.839550 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:46.840113 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.841190 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.842634 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.843485 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.843621 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.843819 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:46.844278 (+ 459us) server_negotiation.cc:299] Negotiation successful
0809 02:29:46.844388 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1229,"thread_start_us":160,"threads_started":1}
I20260809 02:29:46.847752 16044 tablet_service.cc:1467] Processing CreateTablet for tablet 7b51152846fd47f98e016f3f5e5fbf2d (DEFAULT_TABLE table=test-table [id=df30c6ab504148c7adc2ba5b0f1fd1da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:46.848932 16044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b51152846fd47f98e016f3f5e5fbf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:46.848766 15847 tablet_service.cc:1467] Processing CreateTablet for tablet 7b51152846fd47f98e016f3f5e5fbf2d (DEFAULT_TABLE table=test-table [id=df30c6ab504148c7adc2ba5b0f1fd1da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:46.849377 16227 tablet_service.cc:1467] Processing CreateTablet for tablet 7b51152846fd47f98e016f3f5e5fbf2d (DEFAULT_TABLE table=test-table [id=df30c6ab504148c7adc2ba5b0f1fd1da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:46.849920 15847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b51152846fd47f98e016f3f5e5fbf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:46.850530 16227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b51152846fd47f98e016f3f5e5fbf2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:46.855567 16337 tablet_bootstrap.cc:492] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a: Bootstrap starting.
I20260809 02:29:46.857839 16337 tablet_bootstrap.cc:654] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:46.857839 16338 tablet_bootstrap.cc:492] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732: Bootstrap starting.
I20260809 02:29:46.858970 16340 tablet_bootstrap.cc:492] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df: Bootstrap starting.
I20260809 02:29:46.859413 16337 log.cc:824] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:46.860045 16338 tablet_bootstrap.cc:654] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:46.861097 16338 log.cc:824] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:46.861289 16340 tablet_bootstrap.cc:654] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:46.861877 16337 tablet_bootstrap.cc:492] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a: No bootstrap required, opened a new log
I20260809 02:29:46.862112 16337 ts_tablet_manager.cc:1397] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260809 02:29:46.862263 16340 log.cc:824] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:46.863415 16338 tablet_bootstrap.cc:492] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732: No bootstrap required, opened a new log
I20260809 02:29:46.863615 16338 ts_tablet_manager.cc:1397] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:29:46.864292 16340 tablet_bootstrap.cc:492] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df: No bootstrap required, opened a new log
I20260809 02:29:46.864511 16340 ts_tablet_manager.cc:1397] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:29:46.866784 16337 raft_consensus.cc:348] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fe3680565e740ca898761b105ec26df" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36039 } } peers { permanent_uuid: "1e443d685d8b41e2a1ec43aef82a240a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 38891 } } peers { permanent_uuid: "50215cbf0a6b4adebb9c301996226732" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39433 } }
I20260809 02:29:46.867069 16337 raft_consensus.cc:374] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:46.867129 16337 raft_consensus.cc:729] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e443d685d8b41e2a1ec43aef82a240a, State: Initialized, Role: FOLLOWER
I20260809 02:29:46.867635 16337 consensus_queue.cc:260] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fe3680565e740ca898761b105ec26df" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36039 } } peers { permanent_uuid: "1e443d685d8b41e2a1ec43aef82a240a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 38891 } } peers { permanent_uuid: "50215cbf0a6b4adebb9c301996226732" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39433 } }
I20260809 02:29:46.867954 16338 raft_consensus.cc:348] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fe3680565e740ca898761b105ec26df" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36039 } } peers { permanent_uuid: "1e443d685d8b41e2a1ec43aef82a240a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 38891 } } peers { permanent_uuid: "50215cbf0a6b4adebb9c301996226732" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39433 } }
I20260809 02:29:46.868217 16338 raft_consensus.cc:374] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:46.868275 16338 raft_consensus.cc:729] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50215cbf0a6b4adebb9c301996226732, State: Initialized, Role: FOLLOWER
I20260809 02:29:46.868561 16132 heartbeater.cc:503] Master 127.21.214.190:33219 was elected leader, sending a full tablet report...
I20260809 02:29:46.868690 16338 consensus_queue.cc:260] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fe3680565e740ca898761b105ec26df" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36039 } } peers { permanent_uuid: "1e443d685d8b41e2a1ec43aef82a240a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 38891 } } peers { permanent_uuid: "50215cbf0a6b4adebb9c301996226732" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39433 } }
I20260809 02:29:46.868891 16340 raft_consensus.cc:348] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fe3680565e740ca898761b105ec26df" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36039 } } peers { permanent_uuid: "1e443d685d8b41e2a1ec43aef82a240a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 38891 } } peers { permanent_uuid: "50215cbf0a6b4adebb9c301996226732" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39433 } }
I20260809 02:29:46.869159 16340 raft_consensus.cc:374] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:46.869230 16340 raft_consensus.cc:729] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe3680565e740ca898761b105ec26df, State: Initialized, Role: FOLLOWER
I20260809 02:29:46.869729 16338 ts_tablet_manager.cc:1428] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 02:29:46.869707 16340 consensus_queue.cc:260] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fe3680565e740ca898761b105ec26df" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36039 } } peers { permanent_uuid: "1e443d685d8b41e2a1ec43aef82a240a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 38891 } } peers { permanent_uuid: "50215cbf0a6b4adebb9c301996226732" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39433 } }
I20260809 02:29:46.869999 16337 ts_tablet_manager.cc:1428] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260809 02:29:46.870095 15949 heartbeater.cc:503] Master 127.21.214.190:33219 was elected leader, sending a full tablet report...
I20260809 02:29:46.870810 16308 heartbeater.cc:503] Master 127.21.214.190:33219 was elected leader, sending a full tablet report...
I20260809 02:29:46.871878 16340 ts_tablet_manager.cc:1428] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
W20260809 02:29:46.916522 15950 tablet.cc:2369] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:29:46.945760 16344 raft_consensus.cc:482] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:29:46.946030 16344 raft_consensus.cc:504] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fe3680565e740ca898761b105ec26df" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36039 } } peers { permanent_uuid: "1e443d685d8b41e2a1ec43aef82a240a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 38891 } } peers { permanent_uuid: "50215cbf0a6b4adebb9c301996226732" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39433 } }
I20260809 02:29:46.947396 16344 leader_election.cc:288] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fe3680565e740ca898761b105ec26df (127.21.214.131:36039), 50215cbf0a6b4adebb9c301996226732 (127.21.214.129:39433)
I20260809 02:29:46.952684 16134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.947647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:36039 (local address 127.21.214.130:60639)
0809 02:29:46.947867 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:46.947888 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:46.948044 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:46.948366 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:46.948369 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:46.948389 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:46.948523 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.948530 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.949548 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.949550 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.951039 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.951050 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.952059 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.952063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.952211 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.952318 (+ 107us) client_negotiation.cc:769] Sending connection context
0809 02:29:46.952398 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 02:29:46.952501 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":162}
I20260809 02:29:46.952705 16336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.947882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:50083 (local address 127.21.214.129:39433)
0809 02:29:46.948134 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:46.948139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:46.948270 (+ 131us) server_negotiation.cc:407] Connection header received
0809 02:29:46.948453 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:46.948456 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:46.948500 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:46.948589 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:46.948881 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.949385 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.951210 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.951903 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.952054 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.952112 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:46.952466 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 02:29:46.952569 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:29:46.952705 16327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.947766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:60639 (local address 127.21.214.131:36039)
0809 02:29:46.947915 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:46.947920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:46.948021 (+ 101us) server_negotiation.cc:407] Connection header received
0809 02:29:46.948209 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:46.948211 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:46.948257 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:46.948353 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:46.948655 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.949412 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.951210 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.951903 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.952054 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.952112 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:46.952473 (+ 361us) server_negotiation.cc:299] Negotiation successful
0809 02:29:46.952559 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 02:29:46.952692 16351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.947706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:39433 (local address 127.21.214.130:50083)
0809 02:29:46.948154 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:46.948170 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:46.948329 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:46.948603 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:46.948606 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:46.948623 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:46.948756 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.948762 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.949513 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.949520 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.951039 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:46.951050 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.952059 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.952063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:46.952226 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.952314 (+ 88us) client_negotiation.cc:769] Sending connection context
0809 02:29:46.952398 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 02:29:46.952501 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":192,"thread_start_us":139,"threads_started":1}
I20260809 02:29:46.953611 16253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b51152846fd47f98e016f3f5e5fbf2d" candidate_uuid: "1e443d685d8b41e2a1ec43aef82a240a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe3680565e740ca898761b105ec26df" is_pre_election: true
I20260809 02:29:46.953888 15880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b51152846fd47f98e016f3f5e5fbf2d" candidate_uuid: "1e443d685d8b41e2a1ec43aef82a240a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50215cbf0a6b4adebb9c301996226732" is_pre_election: true
I20260809 02:29:46.953955 16253 raft_consensus.cc:2454] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e443d685d8b41e2a1ec43aef82a240a in term 0.
I20260809 02:29:46.954226 15880 raft_consensus.cc:2454] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e443d685d8b41e2a1ec43aef82a240a in term 0.
I20260809 02:29:46.954605 15973 leader_election.cc:302] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e443d685d8b41e2a1ec43aef82a240a, 3fe3680565e740ca898761b105ec26df; no voters:
I20260809 02:29:46.954939 16344 raft_consensus.cc:2781] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:29:46.955025 16344 raft_consensus.cc:482] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:29:46.955082 16344 raft_consensus.cc:3037] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:46.956305 16344 raft_consensus.cc:504] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fe3680565e740ca898761b105ec26df" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36039 } } peers { permanent_uuid: "1e443d685d8b41e2a1ec43aef82a240a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 38891 } } peers { permanent_uuid: "50215cbf0a6b4adebb9c301996226732" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39433 } }
I20260809 02:29:46.956729 16344 leader_election.cc:288] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [CANDIDATE]: Term 1 election: Requested vote from peers 3fe3680565e740ca898761b105ec26df (127.21.214.131:36039), 50215cbf0a6b4adebb9c301996226732 (127.21.214.129:39433)
I20260809 02:29:46.957100 16253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b51152846fd47f98e016f3f5e5fbf2d" candidate_uuid: "1e443d685d8b41e2a1ec43aef82a240a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fe3680565e740ca898761b105ec26df"
I20260809 02:29:46.957176 15880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b51152846fd47f98e016f3f5e5fbf2d" candidate_uuid: "1e443d685d8b41e2a1ec43aef82a240a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50215cbf0a6b4adebb9c301996226732"
I20260809 02:29:46.957252 16253 raft_consensus.cc:3037] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:46.957334 15880 raft_consensus.cc:3037] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:46.958700 16253 raft_consensus.cc:2454] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e443d685d8b41e2a1ec43aef82a240a in term 1.
I20260809 02:29:46.958781 15880 raft_consensus.cc:2454] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e443d685d8b41e2a1ec43aef82a240a in term 1.
I20260809 02:29:46.959146 15972 leader_election.cc:302] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e443d685d8b41e2a1ec43aef82a240a, 50215cbf0a6b4adebb9c301996226732; no voters:
I20260809 02:29:46.959367 16344 raft_consensus.cc:2781] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:46.959645 16344 raft_consensus.cc:686] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [term 1 LEADER]: Becoming Leader. State: Replica: 1e443d685d8b41e2a1ec43aef82a240a, State: Running, Role: LEADER
I20260809 02:29:46.959991 16344 consensus_queue.cc:237] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fe3680565e740ca898761b105ec26df" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36039 } } peers { permanent_uuid: "1e443d685d8b41e2a1ec43aef82a240a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 38891 } } peers { permanent_uuid: "50215cbf0a6b4adebb9c301996226732" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39433 } }
I20260809 02:29:46.963228 15677 catalog_manager.cc:5495] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e443d685d8b41e2a1ec43aef82a240a (127.21.214.130). New cstate: current_term: 1 leader_uuid: "1e443d685d8b41e2a1ec43aef82a240a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3fe3680565e740ca898761b105ec26df" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e443d685d8b41e2a1ec43aef82a240a" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 38891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50215cbf0a6b4adebb9c301996226732" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39433 } health_report { overall_health: UNKNOWN } } }
I20260809 02:29:46.996618 16328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:46.993017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45840 (local address 127.21.214.130:38891)
0809 02:29:46.993155 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:46.993159 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:46.993172 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:29:46.993328 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:46.993330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:46.993388 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:46.993483 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:29:46.993738 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.994258 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.995206 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:46.995415 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:46.995492 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:46.995799 (+ 307us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:29:46.996224 (+ 425us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:29:46.996318 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:46.996461 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 02:29:46.996509 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:29:47.002888 15880 raft_consensus.cc:1261] T 7b51152846fd47f98e016f3f5e5fbf2d P 50215cbf0a6b4adebb9c301996226732 [term 1 FOLLOWER]: Refusing update from remote peer 1e443d685d8b41e2a1ec43aef82a240a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:47.002888 16253 raft_consensus.cc:1261] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df [term 1 FOLLOWER]: Refusing update from remote peer 1e443d685d8b41e2a1ec43aef82a240a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:47.003706 16353 consensus_queue.cc:1035] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fe3680565e740ca898761b105ec26df" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:47.003935 16344 consensus_queue.cc:1035] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [LEADER]: Connected to new peer: Peer: permanent_uuid: "50215cbf0a6b4adebb9c301996226732" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 39433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:47.013999 16358 mvcc.cc:205] Tried to move back new op lower bound from 7316449636355928064 to 7316449636190838784. Current Snapshot: MvccSnapshot[applied={T|T < 7316449636355928064}]
I20260809 02:29:47.015609 16359 mvcc.cc:205] Tried to move back new op lower bound from 7316449636355928064 to 7316449636190838784. Current Snapshot: MvccSnapshot[applied={T|T < 7316449636355928064}]
I20260809 02:29:47.024366 15679 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:47.024570 15679 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:47.027076 15679 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cfe6373fd94f474bb77a329d9aa8ad7a: Sending DeleteTablet for 3 replicas of tablet 7b51152846fd47f98e016f3f5e5fbf2d
I20260809 02:29:47.027905 16044 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b51152846fd47f98e016f3f5e5fbf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:47 UTC) from {username='slave'} at 127.0.0.1:45836
I20260809 02:29:47.028049 15847 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b51152846fd47f98e016f3f5e5fbf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:47 UTC) from {username='slave'} at 127.0.0.1:32978
I20260809 02:29:47.028403 16227 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b51152846fd47f98e016f3f5e5fbf2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:47 UTC) from {username='slave'} at 127.0.0.1:49540
I20260809 02:29:47.028638 16378 tablet_replica.cc:330] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a: stopping tablet replica
I20260809 02:29:47.028807 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 15759
I20260809 02:29:47.041460 16378 raft_consensus.cc:2229] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:29:47.041965 16378 raft_consensus.cc:2258] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:47.045436 16380 tablet_replica.cc:330] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df: stopping tablet replica
I20260809 02:29:47.045809 16380 raft_consensus.cc:2229] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:29:47.046139 16380 raft_consensus.cc:2258] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:47.047115 16378 ts_tablet_manager.cc:1905] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:47.047678 16380 ts_tablet_manager.cc:1905] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:47.050225 16378 ts_tablet_manager.cc:1918] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:47.050341 16378 log.cc:1196] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/7b51152846fd47f98e016f3f5e5fbf2d
I20260809 02:29:47.050729 16378 ts_tablet_manager.cc:1939] T 7b51152846fd47f98e016f3f5e5fbf2d P 1e443d685d8b41e2a1ec43aef82a240a: Deleting consensus metadata
I20260809 02:29:47.050736 16380 ts_tablet_manager.cc:1918] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:47.050945 16380 log.cc:1196] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/7b51152846fd47f98e016f3f5e5fbf2d
I20260809 02:29:47.051367 16380 ts_tablet_manager.cc:1939] T 7b51152846fd47f98e016f3f5e5fbf2d P 3fe3680565e740ca898761b105ec26df: Deleting consensus metadata
I20260809 02:29:47.052217 15658 catalog_manager.cc:4841] TS 1e443d685d8b41e2a1ec43aef82a240a (127.21.214.130:38891): tablet 7b51152846fd47f98e016f3f5e5fbf2d (table test-table [id=df30c6ab504148c7adc2ba5b0f1fd1da]) successfully deleted
I20260809 02:29:47.052573 15656 catalog_manager.cc:4841] TS 3fe3680565e740ca898761b105ec26df (127.21.214.131:36039): tablet 7b51152846fd47f98e016f3f5e5fbf2d (table test-table [id=df30c6ab504148c7adc2ba5b0f1fd1da]) successfully deleted
W20260809 02:29:47.053740 15655 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:39433 (error 108)
I20260809 02:29:47.053979 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 15952
I20260809 02:29:47.056998 16326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:47.056688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:39433 (local address 127.0.0.1:32992)
0809 02:29:47.056859 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:47.056923 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:39433: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 02:29:47.057199 15655 catalog_manager.cc:4584] TS 50215cbf0a6b4adebb9c301996226732 (127.21.214.129:39433): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7b51152846fd47f98e016f3f5e5fbf2d: Network error: Client connection negotiation failed: client connection to 127.21.214.129:39433: connect: Connection refused (error 111)
I20260809 02:29:47.063665 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 16135
I20260809 02:29:47.076901 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 15630
2026-08-09T02:29:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1127 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:29:47 dist-test-slave-68xk krb5kdc[16388](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:29:47 dist-test-slave-68xk krb5kdc[16388](info): set up 2 sockets
Aug 09 02:29:47 dist-test-slave-68xk krb5kdc[16388](info): commencing operation
krb5kdc: starting...
W20260809 02:29:48.408138 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.306s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:29:48 dist-test-slave-68xk krb5kdc[16388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:29:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:29:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:29:48.546224 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:42451
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:42451
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:48.659487 16407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:48.659734 16407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:48.659773 16407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:48.663681 16407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:29:48.663730 16407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:48.663749 16407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:48.663766 16407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:29:48.663781 16407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:29:48.669063 16407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:42451
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:42451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:48.669997 16407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:48.670979 16407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:48.679518 16415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:48.679530 16419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:48.679540 16417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:48.679739 16407 server_base.cc:1034] running on GCE node
I20260809 02:29:48.680444 16407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:48.681546 16407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:48.682741 16407 hybrid_clock.cc:648] HybridClock initialized: now 1786242588682728 us; error 37 us; skew 500 ppm
Aug 09 02:29:48 dist-test-slave-68xk krb5kdc[16388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242588, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:48.685477 16407 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:29:48.686360 16407 webserver.cc:460] Webserver started at http://127.21.214.190:44417/ using document root <none> and password file <none>
I20260809 02:29:48.686959 16407 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:48.687059 16407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:48.687304 16407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:48.689368 16407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "ebff3a43352a42b69f5bd4457ec414aa"
format_stamp: "Formatted at 2026-08-09 02:29:48 on dist-test-slave-68xk"
server_key: "9194d6c7da6eb3636abdcc47c9016988"
server_key_iv: "ed917d6eb439e068cfb474c6981080d7"
server_key_version: "encryptionkey@0"
I20260809 02:29:48.689949 16407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "ebff3a43352a42b69f5bd4457ec414aa"
format_stamp: "Formatted at 2026-08-09 02:29:48 on dist-test-slave-68xk"
server_key: "9194d6c7da6eb3636abdcc47c9016988"
server_key_iv: "ed917d6eb439e068cfb474c6981080d7"
server_key_version: "encryptionkey@0"
I20260809 02:29:48.693833 16407 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 02:29:48.696311 16429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:48.697489 16407 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:29:48.697651 16407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "ebff3a43352a42b69f5bd4457ec414aa"
format_stamp: "Formatted at 2026-08-09 02:29:48 on dist-test-slave-68xk"
server_key: "9194d6c7da6eb3636abdcc47c9016988"
server_key_iv: "ed917d6eb439e068cfb474c6981080d7"
server_key_version: "encryptionkey@0"
I20260809 02:29:48.697779 16407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:48.707608 16407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:48.710806 16407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:48.711045 16407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:48.718704 16407 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:42451
I20260809 02:29:48.718747 16499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:42451 every 8 connection(s)
I20260809 02:29:48.719723 16407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:29:48.722541 16500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:48.723364 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 16407
I20260809 02:29:48.723531 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:29:48.723832 22362 external_mini_cluster.cc:1428] Setting key bbbefcedf04499494097e66de32b43a2
I20260809 02:29:48.729264 16500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa: Bootstrap starting.
I20260809 02:29:48.732007 16500 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:48.732928 16500 log.cc:824] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:29:48 dist-test-slave-68xk krb5kdc[16388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:29:48.735136 16500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa: No bootstrap required, opened a new log
I20260809 02:29:48.738792 16503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:48.725200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33516 (local address 127.21.214.190:42451)
0809 02:29:48.725619 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:48.725639 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:48.725682 (+ 43us) server_negotiation.cc:407] Connection header received
0809 02:29:48.726507 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:48.726530 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:48.726939 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:48.727306 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:48.728045 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:48.729491 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:48.730403 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:48.730911 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:48.731109 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:48.733882 (+ 2773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:48.733888 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:48.733901 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:48.733929 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:48.735805 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:48.736276 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:48.736281 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:48.736286 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:48.736400 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:48.736720 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:48.736723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:48.736725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:48.737129 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:48.737344 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:48.737664 (+ 320us) server_negotiation.cc:299] Negotiation successful
0809 02:29:48.737965 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":108,"threads_started":1}
I20260809 02:29:48.738791 16500 raft_consensus.cc:348] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebff3a43352a42b69f5bd4457ec414aa" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42451 } }
I20260809 02:29:48.739154 16500 raft_consensus.cc:374] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:48.739234 16500 raft_consensus.cc:729] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebff3a43352a42b69f5bd4457ec414aa, State: Initialized, Role: FOLLOWER
I20260809 02:29:48.739764 16500 consensus_queue.cc:260] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebff3a43352a42b69f5bd4457ec414aa" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42451 } }
I20260809 02:29:48.739939 16500 raft_consensus.cc:388] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:29:48.740017 16500 raft_consensus.cc:482] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:29:48.740115 16500 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:48.741272 16500 raft_consensus.cc:504] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebff3a43352a42b69f5bd4457ec414aa" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42451 } }
I20260809 02:29:48.741585 16500 leader_election.cc:302] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ebff3a43352a42b69f5bd4457ec414aa; no voters:
I20260809 02:29:48.741837 16500 leader_election.cc:288] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:29:48.741966 16508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:48.742247 16508 raft_consensus.cc:686] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [term 1 LEADER]: Becoming Leader. State: Replica: ebff3a43352a42b69f5bd4457ec414aa, State: Running, Role: LEADER
I20260809 02:29:48.742655 16508 consensus_queue.cc:237] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebff3a43352a42b69f5bd4457ec414aa" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42451 } }
I20260809 02:29:48.743095 16500 sys_catalog.cc:564] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:29:48.744385 16509 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ebff3a43352a42b69f5bd4457ec414aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebff3a43352a42b69f5bd4457ec414aa" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42451 } } }
I20260809 02:29:48.744539 16509 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:48.744413 16510 sys_catalog.cc:455] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [sys.catalog]: SysCatalogTable state changed. Reason: New leader ebff3a43352a42b69f5bd4457ec414aa. Latest consensus state: current_term: 1 leader_uuid: "ebff3a43352a42b69f5bd4457ec414aa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ebff3a43352a42b69f5bd4457ec414aa" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 42451 } } }
I20260809 02:29:48.744608 16510 sys_catalog.cc:458] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:48.745028 16522 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:29:48.748550 16522 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:29:48.754470 16522 catalog_manager.cc:1347] Generated new cluster ID: 9563c061bb0b47e5a0167c88f93437d1
I20260809 02:29:48.754536 16522 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:29:48.769517 16522 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:29:48.770828 16522 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:29:48.784875 16522 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa: Generated new TSK 0
I20260809 02:29:48.785748 16522 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:29:48.818583 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42451
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:48.937403 16541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:48.937662 16541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:48.937706 16541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:48.941725 16541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:48.941781 16541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:48.941879 16541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:29:48.947521 16541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:48.948604 16541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:48.949676 16541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:48.959793 16553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:48.959780 16551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:48.960035 16541 server_base.cc:1034] running on GCE node
W20260809 02:29:48.960253 16556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:48.960678 16541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:48.961351 16541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:48.962522 16541 hybrid_clock.cc:648] HybridClock initialized: now 1786242588962497 us; error 36 us; skew 500 ppm
Aug 09 02:29:48 dist-test-slave-68xk krb5kdc[16388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242588, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:48.965483 16541 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:29:48.966512 16541 webserver.cc:460] Webserver started at http://127.21.214.129:39179/ using document root <none> and password file <none>
I20260809 02:29:48.967114 16541 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:48.967211 16541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:48.967447 16541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:48.969532 16541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "60fa9afdb9274150ac59eb5606536e21"
format_stamp: "Formatted at 2026-08-09 02:29:48 on dist-test-slave-68xk"
server_key: "e0ea1fe8f900d3c1d4bd0a0d5e245b5f"
server_key_iv: "c10100d54474cad58536e3f457ad1480"
server_key_version: "encryptionkey@0"
I20260809 02:29:48.970131 16541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "60fa9afdb9274150ac59eb5606536e21"
format_stamp: "Formatted at 2026-08-09 02:29:48 on dist-test-slave-68xk"
server_key: "e0ea1fe8f900d3c1d4bd0a0d5e245b5f"
server_key_iv: "c10100d54474cad58536e3f457ad1480"
server_key_version: "encryptionkey@0"
I20260809 02:29:48.974045 16541 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260809 02:29:48.976701 16567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:48.978134 16541 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:29:48.978297 16541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "60fa9afdb9274150ac59eb5606536e21"
format_stamp: "Formatted at 2026-08-09 02:29:48 on dist-test-slave-68xk"
server_key: "e0ea1fe8f900d3c1d4bd0a0d5e245b5f"
server_key_iv: "c10100d54474cad58536e3f457ad1480"
server_key_version: "encryptionkey@0"
I20260809 02:29:48.978451 16541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:49.012035 16541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:49.016574 16541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:49.016822 16541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:49.017513 16541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:49.018545 16541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:49.018602 16541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:49.018648 16541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:49.018687 16541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:49.028815 16541 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:40479
I20260809 02:29:49.028846 16724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:40479 every 8 connection(s)
I20260809 02:29:49.029778 16541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:29:49.036417 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 16541
I20260809 02:29:49.036566 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:29:49.036926 22362 external_mini_cluster.cc:1428] Setting key cac035c2d32af9ebfe972027740e7175
Aug 09 02:29:49 dist-test-slave-68xk krb5kdc[16388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242588, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:29:49.046064 16503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.031854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:33561 (local address 127.21.214.190:42451)
0809 02:29:49.032037 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:49.032043 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:49.032965 (+ 922us) server_negotiation.cc:407] Connection header received
0809 02:29:49.034488 (+ 1523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:49.034495 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:49.034568 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:49.034652 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:49.035944 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.036755 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.038260 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.038573 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.038699 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.041720 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:49.041723 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:49.041725 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:49.041749 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:49.043668 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:49.044304 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:49.044310 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:49.044315 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:49.044417 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:49.044853 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:49.044860 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:49.044865 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:49.045107 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:49.045216 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:49.045736 (+ 520us) server_negotiation.cc:299] Negotiation successful
0809 02:29:49.045885 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 02:29:49.046914 16727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.032272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:42451 (local address 127.21.214.129:33561)
0809 02:29:49.032794 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:49.032842 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:49.034206 (+ 1364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:49.034836 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:49.034843 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:49.035268 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:49.035785 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.035799 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.036913 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.036916 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.038092 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.038103 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.038735 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.038738 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.038897 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.039594 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:49.039613 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:49.041516 (+ 1903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:49.043791 (+ 2275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:49.043797 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:49.043810 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:49.044190 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:49.044530 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:49.044533 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:49.044534 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:49.044753 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:49.045237 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:49.045244 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:49.045494 (+ 250us) client_negotiation.cc:769] Sending connection context
0809 02:29:49.045690 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 02:29:49.046021 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":138,"threads_started":1}
I20260809 02:29:49.048205 16725 heartbeater.cc:347] Connected to a master server at 127.21.214.190:42451
I20260809 02:29:49.048502 16725 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:49.049175 16725 heartbeater.cc:511] Master 127.21.214.190:42451 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
I20260809 02:29:49.051002 16451 ts_manager.cc:194] Registered new tserver with Master: 60fa9afdb9274150ac59eb5606536e21 (127.21.214.129:40479)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
I20260809 02:29:49.052278 16451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:33561
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:29:49.069775 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42451
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:49.198256 16732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:49.198588 16732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:49.198670 16732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:49.203015 16732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:49.203073 16732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:49.203130 16732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:29:49.208375 16732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:49.209407 16732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:49.210469 16732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:49.220301 16742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:49.220301 16738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:49.220288 16737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:49.220445 16732 server_base.cc:1034] running on GCE node
I20260809 02:29:49.221047 16732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:49.221693 16732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:49.222853 16732 hybrid_clock.cc:648] HybridClock initialized: now 1786242589222823 us; error 46 us; skew 500 ppm
Aug 09 02:29:49 dist-test-slave-68xk krb5kdc[16388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242589, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:49.225648 16732 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:29:49.226590 16732 webserver.cc:460] Webserver started at http://127.21.214.130:46719/ using document root <none> and password file <none>
I20260809 02:29:49.227188 16732 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:49.227289 16732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:49.227526 16732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:49.229540 16732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "534417eb89174eb899356b2f4d309fd2"
format_stamp: "Formatted at 2026-08-09 02:29:49 on dist-test-slave-68xk"
server_key: "987e96dea9e3887445d80a1c7476e348"
server_key_iv: "a6c0fda43ae6f6ad03d024f0ad525431"
server_key_version: "encryptionkey@0"
I20260809 02:29:49.230108 16732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "534417eb89174eb899356b2f4d309fd2"
format_stamp: "Formatted at 2026-08-09 02:29:49 on dist-test-slave-68xk"
server_key: "987e96dea9e3887445d80a1c7476e348"
server_key_iv: "a6c0fda43ae6f6ad03d024f0ad525431"
server_key_version: "encryptionkey@0"
I20260809 02:29:49.233786 16732 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:29:49.236279 16751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:49.237573 16732 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:29:49.237704 16732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "534417eb89174eb899356b2f4d309fd2"
format_stamp: "Formatted at 2026-08-09 02:29:49 on dist-test-slave-68xk"
server_key: "987e96dea9e3887445d80a1c7476e348"
server_key_iv: "a6c0fda43ae6f6ad03d024f0ad525431"
server_key_version: "encryptionkey@0"
I20260809 02:29:49.237813 16732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:49.253713 16732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:49.256784 16732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:49.256978 16732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:49.257545 16732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:49.258373 16732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:49.258466 16732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:49.258576 16732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:49.258615 16732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:49.267863 16732 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:35413
I20260809 02:29:49.267896 16918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:35413 every 8 connection(s)
I20260809 02:29:49.268729 16732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:29:49.277117 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 16732
I20260809 02:29:49.277262 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:29:49.277565 22362 external_mini_cluster.cc:1428] Setting key b254bcf483c9a25e6ff220365e5cc962
Aug 09 02:29:49 dist-test-slave-68xk krb5kdc[16388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242589, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:29:49.284690 16503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.270598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:35323 (local address 127.21.214.190:42451)
0809 02:29:49.270747 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:49.270754 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:49.271637 (+ 883us) server_negotiation.cc:407] Connection header received
0809 02:29:49.273230 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:49.273234 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:49.273298 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:49.273390 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:49.274802 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.275403 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.276718 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.277003 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.277135 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.280173 (+ 3038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:49.280176 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:49.280179 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:49.280203 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:49.282039 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:49.282787 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:49.282790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:49.282792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:49.282884 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:49.283320 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:49.283326 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:49.283328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:49.283659 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:49.283784 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:49.284346 (+ 562us) server_negotiation.cc:299] Negotiation successful
0809 02:29:49.284486 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 02:29:49.285791 16921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.270934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:42451 (local address 127.21.214.130:35323)
0809 02:29:49.271454 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:49.271502 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:49.272969 (+ 1467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:49.273573 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:49.273580 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:49.273988 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:49.274631 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.274650 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.275559 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.275563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.276567 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.276578 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.277182 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.277187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.277421 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.278190 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:49.278216 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:49.279982 (+ 1766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:49.282257 (+ 2275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:49.282264 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:49.282282 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:49.282666 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:49.282993 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:49.282996 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:49.282998 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:49.283180 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:49.283789 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:49.283795 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:49.284061 (+ 266us) client_negotiation.cc:769] Sending connection context
0809 02:29:49.284281 (+ 220us) client_negotiation.cc:240] Negotiation successful
0809 02:29:49.284714 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":134,"threads_started":1}
I20260809 02:29:49.287142 16919 heartbeater.cc:347] Connected to a master server at 127.21.214.190:42451
I20260809 02:29:49.287395 16919 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:49.287951 16919 heartbeater.cc:511] Master 127.21.214.190:42451 requested a full tablet report, sending...
I20260809 02:29:49.289063 16451 ts_manager.cc:194] Registered new tserver with Master: 534417eb89174eb899356b2f4d309fd2 (127.21.214.130:35413)
I20260809 02:29:49.289682 16451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:35323
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:29:49.309804 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42451
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:49.422977 16925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:49.423228 16925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:49.423269 16925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:49.427299 16925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:49.427348 16925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:49.427404 16925 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:29:49.432412 16925 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:42451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:49.433343 16925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:49.434283 16925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:49.444509 16932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:49.444552 16936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:49.444555 16931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:49.444733 16925 server_base.cc:1034] running on GCE node
I20260809 02:29:49.445329 16925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:49.445909 16925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:49.447072 16925 hybrid_clock.cc:648] HybridClock initialized: now 1786242589447055 us; error 32 us; skew 500 ppm
Aug 09 02:29:49 dist-test-slave-68xk krb5kdc[16388](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242589, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:49.449783 16925 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:29:49.450668 16925 webserver.cc:460] Webserver started at http://127.21.214.131:46799/ using document root <none> and password file <none>
I20260809 02:29:49.451200 16925 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:49.451261 16925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:49.451426 16925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:49.453428 16925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "5e2107697506419dad2c732fde3faad3"
format_stamp: "Formatted at 2026-08-09 02:29:49 on dist-test-slave-68xk"
server_key: "be1f23b44f57c41aa365ef361e0fa6df"
server_key_iv: "0287c07da9e6a1455c3807b8d070e5eb"
server_key_version: "encryptionkey@0"
I20260809 02:29:49.454032 16925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "5e2107697506419dad2c732fde3faad3"
format_stamp: "Formatted at 2026-08-09 02:29:49 on dist-test-slave-68xk"
server_key: "be1f23b44f57c41aa365ef361e0fa6df"
server_key_iv: "0287c07da9e6a1455c3807b8d070e5eb"
server_key_version: "encryptionkey@0"
I20260809 02:29:49.457854 16925 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:29:49.460332 16945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:49.461681 16925 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:29:49.461824 16925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "5e2107697506419dad2c732fde3faad3"
format_stamp: "Formatted at 2026-08-09 02:29:49 on dist-test-slave-68xk"
server_key: "be1f23b44f57c41aa365ef361e0fa6df"
server_key_iv: "0287c07da9e6a1455c3807b8d070e5eb"
server_key_version: "encryptionkey@0"
I20260809 02:29:49.461938 16925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:49.481333 16925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:49.484644 16925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:49.484846 16925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:49.485507 16925 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:49.486357 16925 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:49.486483 16925 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:49.486573 16925 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:49.486613 16925 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:49.496114 16925 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:45753
I20260809 02:29:49.496137 17120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:45753 every 8 connection(s)
I20260809 02:29:49.497001 16925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:29:49.506703 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 16925
I20260809 02:29:49.506852 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
Aug 09 02:29:49 dist-test-slave-68xk krb5kdc[16388](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242589, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:29:49.507217 22362 external_mini_cluster.cc:1428] Setting key 9435099e657dee30894fc51c34258cf5
I20260809 02:29:49.511688 16503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.498889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:60491 (local address 127.21.214.190:42451)
0809 02:29:49.499021 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:49.499033 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:49.499845 (+ 812us) server_negotiation.cc:407] Connection header received
0809 02:29:49.501285 (+ 1440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:49.501289 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:49.501348 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:49.501448 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:49.502846 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.503383 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.504537 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.504770 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.504885 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.507793 (+ 2908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:49.507797 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:49.507799 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:49.507827 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:49.509573 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:49.510089 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:49.510093 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:49.510095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:49.510188 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:49.510601 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:49.510605 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:49.510607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:49.510796 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:49.510910 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:49.511410 (+ 500us) server_negotiation.cc:299] Negotiation successful
0809 02:29:49.511528 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:29:49.512447 17124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.499229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:42451 (local address 127.21.214.131:60491)
0809 02:29:49.499684 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:49.499728 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:49.501062 (+ 1334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:49.501674 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:49.501683 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:49.502110 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:49.502692 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.502707 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.503519 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.503522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.504406 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.504416 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.504928 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.504932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.505115 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.505691 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:49.505706 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:49.507572 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:49.509695 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:49.509701 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:49.509715 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:49.509978 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:49.510285 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:49.510289 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:49.510291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:49.510486 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:49.510909 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:49.510916 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:49.511159 (+ 243us) client_negotiation.cc:769] Sending connection context
0809 02:29:49.511347 (+ 188us) client_negotiation.cc:240] Negotiation successful
0809 02:29:49.511683 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":111,"threads_started":1}
I20260809 02:29:49.513564 17121 heartbeater.cc:347] Connected to a master server at 127.21.214.190:42451
I20260809 02:29:49.513831 17121 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:49.514313 17121 heartbeater.cc:511] Master 127.21.214.190:42451 requested a full tablet report, sending...
I20260809 02:29:49.515372 16451 ts_manager.cc:194] Registered new tserver with Master: 5e2107697506419dad2c732fde3faad3 (127.21.214.131:45753)
I20260809 02:29:49.515930 16451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:60491
I20260809 02:29:49.521540 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:29:49.531303 16503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.523579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33518 (local address 127.21.214.190:42451)
0809 02:29:49.523697 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:49.523700 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:49.523983 (+ 283us) server_negotiation.cc:407] Connection header received
0809 02:29:49.524053 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:49.524056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:49.524094 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:49.524165 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:49.524891 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.525419 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.526263 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.526546 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.526634 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.528108 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:49.528112 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:49.528113 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:49.528135 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:49.529456 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:49.529972 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:49.529975 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:49.529976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:49.530050 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:49.530477 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:49.530480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:49.530481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:49.530679 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:49.530798 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:49.531082 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 02:29:49.531188 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 02:29:49.534309 16451 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33518:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:29:49.537335 16451 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:29:49.552757 17142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.546889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47094 (local address 127.21.214.131:45753)
0809 02:29:49.547472 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:49.547487 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:49.547512 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:29:49.547604 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:49.547609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:49.547817 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:49.547978 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:49.548308 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.549485 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.551127 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.552005 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.552178 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.552279 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:49.552494 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 02:29:49.552603 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":104,"threads_started":1}
I20260809 02:29:49.552758 17139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.546163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:45753 (local address 127.0.0.1:47094)
0809 02:29:49.546524 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:49.546570 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:49.546696 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:49.547972 (+ 1276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:49.547978 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:49.548003 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:49.548177 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.548184 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.549653 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.549657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.550996 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.551005 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.552163 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.552166 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.552287 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.552331 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 02:29:49.552447 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 02:29:49.552560 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":20,"thread_start_us":104,"threads_started":1}
I20260809 02:29:49.553047 17146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.546978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34346 (local address 127.21.214.130:35413)
0809 02:29:49.547500 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:49.547513 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:49.547537 (+ 24us) server_negotiation.cc:407] Connection header received
0809 02:29:49.547613 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:49.547619 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:49.547820 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:49.548401 (+ 581us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:49.548625 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.549689 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.551200 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.552005 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.552143 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.552279 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:49.552832 (+ 553us) server_negotiation.cc:299] Negotiation successful
0809 02:29:49.552931 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":180,"threads_started":1}
I20260809 02:29:49.552760 17141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.546254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:35413 (local address 127.0.0.1:34346)
0809 02:29:49.547023 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:49.547038 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:49.547137 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:49.548394 (+ 1257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:49.548397 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:49.548417 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:49.548517 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.548523 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.549942 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.549944 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.551101 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.551111 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.552343 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.552346 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.552448 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.552473 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 02:29:49.552546 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 02:29:49.552609 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"mutex_wait_us":3,"thread_start_us":104,"threads_started":1}
I20260809 02:29:49.555177 17140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.546574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:40479 (local address 127.0.0.1:44726)
0809 02:29:49.547420 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:49.547434 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:49.547725 (+ 291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:49.548794 (+ 1069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:49.548796 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:49.548811 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:49.548889 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.548893 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.551210 (+ 2317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.551212 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.551901 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.551908 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.554733 (+ 2825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.554737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.554834 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.554857 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 02:29:49.554947 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 02:29:49.555021 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":784,"thread_start_us":90,"threads_started":1}
I20260809 02:29:49.555210 17145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.547010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44726 (local address 127.21.214.129:40479)
0809 02:29:49.548238 (+ 1228us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:49.548251 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:49.548268 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:29:49.548325 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:49.548328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:49.548519 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:49.548677 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:49.549007 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.549709 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.552113 (+ 2404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.554622 (+ 2509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.554751 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.554869 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:49.554973 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 02:29:49.555067 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1137,"thread_start_us":68,"threads_started":1}
I20260809 02:29:49.556138 17023 tablet_service.cc:1467] Processing CreateTablet for tablet c30dfab30ba1410b91b664662ca079aa (DEFAULT_TABLE table=test-table [id=ff6149526539495fbe383441d8f46b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:49.556689 16826 tablet_service.cc:1467] Processing CreateTablet for tablet c30dfab30ba1410b91b664662ca079aa (DEFAULT_TABLE table=test-table [id=ff6149526539495fbe383441d8f46b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:49.557204 17023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c30dfab30ba1410b91b664662ca079aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:49.557516 16826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c30dfab30ba1410b91b664662ca079aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:49.563503 17147 tablet_bootstrap.cc:492] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2: Bootstrap starting.
I20260809 02:29:49.564953 16632 tablet_service.cc:1467] Processing CreateTablet for tablet c30dfab30ba1410b91b664662ca079aa (DEFAULT_TABLE table=test-table [id=ff6149526539495fbe383441d8f46b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:49.565663 17147 tablet_bootstrap.cc:654] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:49.565855 16632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c30dfab30ba1410b91b664662ca079aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:49.566941 17147 log.cc:824] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:49.567667 17150 tablet_bootstrap.cc:492] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3: Bootstrap starting.
I20260809 02:29:49.568774 17147 tablet_bootstrap.cc:492] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2: No bootstrap required, opened a new log
I20260809 02:29:49.568990 17147 ts_tablet_manager.cc:1397] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:29:49.571602 17153 tablet_bootstrap.cc:492] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21: Bootstrap starting.
I20260809 02:29:49.572523 17147 raft_consensus.cc:348] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2107697506419dad2c732fde3faad3" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 45753 } } peers { permanent_uuid: "534417eb89174eb899356b2f4d309fd2" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35413 } } peers { permanent_uuid: "60fa9afdb9274150ac59eb5606536e21" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40479 } }
I20260809 02:29:49.572816 17147 raft_consensus.cc:374] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:49.572871 17147 raft_consensus.cc:729] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 534417eb89174eb899356b2f4d309fd2, State: Initialized, Role: FOLLOWER
I20260809 02:29:49.573076 17150 tablet_bootstrap.cc:654] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:49.573390 17147 consensus_queue.cc:260] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2107697506419dad2c732fde3faad3" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 45753 } } peers { permanent_uuid: "534417eb89174eb899356b2f4d309fd2" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35413 } } peers { permanent_uuid: "60fa9afdb9274150ac59eb5606536e21" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40479 } }
I20260809 02:29:49.573741 17153 tablet_bootstrap.cc:654] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:49.574250 16919 heartbeater.cc:503] Master 127.21.214.190:42451 was elected leader, sending a full tablet report...
I20260809 02:29:49.574498 17150 log.cc:824] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:49.574714 17153 log.cc:824] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:49.575320 17147 ts_tablet_manager.cc:1428] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260809 02:29:49.576764 17153 tablet_bootstrap.cc:492] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21: No bootstrap required, opened a new log
I20260809 02:29:49.576769 17150 tablet_bootstrap.cc:492] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3: No bootstrap required, opened a new log
I20260809 02:29:49.576967 17150 ts_tablet_manager.cc:1397] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260809 02:29:49.576967 17153 ts_tablet_manager.cc:1397] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260809 02:29:49.581103 17150 raft_consensus.cc:348] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2107697506419dad2c732fde3faad3" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 45753 } } peers { permanent_uuid: "534417eb89174eb899356b2f4d309fd2" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35413 } } peers { permanent_uuid: "60fa9afdb9274150ac59eb5606536e21" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40479 } }
I20260809 02:29:49.581390 17150 raft_consensus.cc:374] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:49.581451 17150 raft_consensus.cc:729] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e2107697506419dad2c732fde3faad3, State: Initialized, Role: FOLLOWER
I20260809 02:29:49.581466 17153 raft_consensus.cc:348] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2107697506419dad2c732fde3faad3" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 45753 } } peers { permanent_uuid: "534417eb89174eb899356b2f4d309fd2" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35413 } } peers { permanent_uuid: "60fa9afdb9274150ac59eb5606536e21" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40479 } }
I20260809 02:29:49.581727 17153 raft_consensus.cc:374] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:49.581784 17153 raft_consensus.cc:729] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60fa9afdb9274150ac59eb5606536e21, State: Initialized, Role: FOLLOWER
I20260809 02:29:49.581935 17150 consensus_queue.cc:260] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2107697506419dad2c732fde3faad3" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 45753 } } peers { permanent_uuid: "534417eb89174eb899356b2f4d309fd2" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35413 } } peers { permanent_uuid: "60fa9afdb9274150ac59eb5606536e21" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40479 } }
I20260809 02:29:49.582207 17153 consensus_queue.cc:260] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2107697506419dad2c732fde3faad3" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 45753 } } peers { permanent_uuid: "534417eb89174eb899356b2f4d309fd2" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35413 } } peers { permanent_uuid: "60fa9afdb9274150ac59eb5606536e21" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40479 } }
I20260809 02:29:49.582690 17121 heartbeater.cc:503] Master 127.21.214.190:42451 was elected leader, sending a full tablet report...
I20260809 02:29:49.583006 17150 ts_tablet_manager.cc:1428] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3: Time spent starting tablet: real 0.006s user 0.001s sys 0.006s
I20260809 02:29:49.583055 17153 ts_tablet_manager.cc:1428] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:29:49.583361 16725 heartbeater.cc:503] Master 127.21.214.190:42451 was elected leader, sending a full tablet report...
W20260809 02:29:49.747994 17122 tablet.cc:2369] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:29:49.769955 16920 tablet.cc:2369] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:29:49.781482 16726 tablet.cc:2369] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:29:49.870008 17161 raft_consensus.cc:482] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:29:49.870318 17161 raft_consensus.cc:504] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2107697506419dad2c732fde3faad3" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 45753 } } peers { permanent_uuid: "534417eb89174eb899356b2f4d309fd2" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35413 } } peers { permanent_uuid: "60fa9afdb9274150ac59eb5606536e21" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40479 } }
I20260809 02:29:49.871560 17161 leader_election.cc:288] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 534417eb89174eb899356b2f4d309fd2 (127.21.214.130:35413), 60fa9afdb9274150ac59eb5606536e21 (127.21.214.129:40479)
I20260809 02:29:49.877017 17146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.872169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:57063 (local address 127.21.214.130:35413)
0809 02:29:49.872312 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:49.872319 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:49.872570 (+ 251us) server_negotiation.cc:407] Connection header received
0809 02:29:49.872642 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:49.872645 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:49.872695 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:49.872788 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:49.873099 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.873833 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.875670 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.876289 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.876441 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.876503 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:49.876791 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 02:29:49.876883 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 02:29:49.877017 17145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.872261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:33649 (local address 127.21.214.129:40479)
0809 02:29:49.872402 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:49.872405 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:49.872418 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:29:49.872472 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:49.872474 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:49.872541 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:49.872645 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:49.872952 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.873760 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.875670 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.876377 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.876484 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.876538 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:49.876791 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 02:29:49.876895 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:29:49.877018 17124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.871981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:40479 (local address 127.21.214.131:33649)
0809 02:29:49.872097 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:49.872116 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:49.872224 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:49.872646 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:49.872648 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:49.872657 (+ 9us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:49.872812 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.872818 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.873919 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.873924 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.875503 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.875515 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.876488 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.876491 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.876591 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.876654 (+ 63us) client_negotiation.cc:769] Sending connection context
0809 02:29:49.876738 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 02:29:49.876852 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":184}
I20260809 02:29:49.877027 17165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.871981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:35413 (local address 127.21.214.131:57063)
0809 02:29:49.872457 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:49.872468 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:49.872551 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:49.872811 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:49.872813 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:49.872828 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:49.872982 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.872987 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.873929 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.873932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.875502 (+ 1570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:49.875515 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.876461 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.876468 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:49.876587 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.876643 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 02:29:49.876729 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 02:29:49.876846 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":276,"thread_start_us":136,"threads_started":1}
I20260809 02:29:49.877823 16657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c30dfab30ba1410b91b664662ca079aa" candidate_uuid: "5e2107697506419dad2c732fde3faad3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fa9afdb9274150ac59eb5606536e21" is_pre_election: true
I20260809 02:29:49.877959 16858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c30dfab30ba1410b91b664662ca079aa" candidate_uuid: "5e2107697506419dad2c732fde3faad3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "534417eb89174eb899356b2f4d309fd2" is_pre_election: true
I20260809 02:29:49.878204 16858 raft_consensus.cc:2454] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2107697506419dad2c732fde3faad3 in term 0.
I20260809 02:29:49.878204 16657 raft_consensus.cc:2454] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e2107697506419dad2c732fde3faad3 in term 0.
I20260809 02:29:49.878862 16949 leader_election.cc:302] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 534417eb89174eb899356b2f4d309fd2, 5e2107697506419dad2c732fde3faad3, 60fa9afdb9274150ac59eb5606536e21; no voters:
I20260809 02:29:49.879225 17161 raft_consensus.cc:2781] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:29:49.879369 17161 raft_consensus.cc:482] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:29:49.879458 17161 raft_consensus.cc:3037] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:49.880592 17161 raft_consensus.cc:504] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2107697506419dad2c732fde3faad3" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 45753 } } peers { permanent_uuid: "534417eb89174eb899356b2f4d309fd2" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35413 } } peers { permanent_uuid: "60fa9afdb9274150ac59eb5606536e21" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40479 } }
I20260809 02:29:49.880990 17161 leader_election.cc:288] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [CANDIDATE]: Term 1 election: Requested vote from peers 534417eb89174eb899356b2f4d309fd2 (127.21.214.130:35413), 60fa9afdb9274150ac59eb5606536e21 (127.21.214.129:40479)
I20260809 02:29:49.881453 16858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c30dfab30ba1410b91b664662ca079aa" candidate_uuid: "5e2107697506419dad2c732fde3faad3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "534417eb89174eb899356b2f4d309fd2"
I20260809 02:29:49.881464 16657 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c30dfab30ba1410b91b664662ca079aa" candidate_uuid: "5e2107697506419dad2c732fde3faad3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60fa9afdb9274150ac59eb5606536e21"
I20260809 02:29:49.881618 16858 raft_consensus.cc:3037] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:49.881647 16657 raft_consensus.cc:3037] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:49.882869 16657 raft_consensus.cc:2454] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2107697506419dad2c732fde3faad3 in term 1.
I20260809 02:29:49.882970 16858 raft_consensus.cc:2454] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e2107697506419dad2c732fde3faad3 in term 1.
I20260809 02:29:49.883266 16949 leader_election.cc:302] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e2107697506419dad2c732fde3faad3, 60fa9afdb9274150ac59eb5606536e21; no voters:
I20260809 02:29:49.883476 17161 raft_consensus.cc:2781] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:49.883716 17161 raft_consensus.cc:686] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [term 1 LEADER]: Becoming Leader. State: Replica: 5e2107697506419dad2c732fde3faad3, State: Running, Role: LEADER
I20260809 02:29:49.884059 17161 consensus_queue.cc:237] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2107697506419dad2c732fde3faad3" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 45753 } } peers { permanent_uuid: "534417eb89174eb899356b2f4d309fd2" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35413 } } peers { permanent_uuid: "60fa9afdb9274150ac59eb5606536e21" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40479 } }
I20260809 02:29:49.887782 16450 catalog_manager.cc:5495] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e2107697506419dad2c732fde3faad3 (127.21.214.131). New cstate: current_term: 1 leader_uuid: "5e2107697506419dad2c732fde3faad3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e2107697506419dad2c732fde3faad3" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 45753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "534417eb89174eb899356b2f4d309fd2" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60fa9afdb9274150ac59eb5606536e21" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40479 } health_report { overall_health: UNKNOWN } } }
I20260809 02:29:49.922032 17142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.918353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47102 (local address 127.21.214.131:45753)
0809 02:29:49.918518 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:49.918522 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:49.918536 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:29:49.918615 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:49.918617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:49.918674 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:49.918780 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:29:49.919030 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.919619 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.920515 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:49.920755 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:49.920863 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:49.921202 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:29:49.921596 (+ 394us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:29:49.921755 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:49.921869 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 02:29:49.921908 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 02:29:49.928282 16858 raft_consensus.cc:1261] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2 [term 1 FOLLOWER]: Refusing update from remote peer 5e2107697506419dad2c732fde3faad3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:49.928301 16657 raft_consensus.cc:1261] T c30dfab30ba1410b91b664662ca079aa P 60fa9afdb9274150ac59eb5606536e21 [term 1 FOLLOWER]: Refusing update from remote peer 5e2107697506419dad2c732fde3faad3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:49.929085 17161 consensus_queue.cc:1035] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60fa9afdb9274150ac59eb5606536e21" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:49.929332 17166 consensus_queue.cc:1035] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "534417eb89174eb899356b2f4d309fd2" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:49.938746 17172 mvcc.cc:205] Tried to move back new op lower bound from 7316449648338272256 to 7316449648168087552. Current Snapshot: MvccSnapshot[applied={T|T < 7316449648338272256}]
I20260809 02:29:49.946863 16450 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:49.947057 16450 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:49.949770 16450 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ebff3a43352a42b69f5bd4457ec414aa: Sending DeleteTablet for 3 replicas of tablet c30dfab30ba1410b91b664662ca079aa
I20260809 02:29:49.950609 17023 tablet_service.cc:1514] Processing DeleteTablet for tablet c30dfab30ba1410b91b664662ca079aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:49 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:47094
I20260809 02:29:49.950667 16826 tablet_service.cc:1514] Processing DeleteTablet for tablet c30dfab30ba1410b91b664662ca079aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:49 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:34346
I20260809 02:29:49.951237 17186 tablet_replica.cc:330] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2: stopping tablet replica
I20260809 02:29:49.951181 16632 tablet_service.cc:1514] Processing DeleteTablet for tablet c30dfab30ba1410b91b664662ca079aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:49 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:44726
I20260809 02:29:49.951565 17186 raft_consensus.cc:2229] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:29:49.951613 17185 tablet_replica.cc:330] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3: stopping tablet replica
I20260809 02:29:49.951928 17186 raft_consensus.cc:2258] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:49.951932 17185 raft_consensus.cc:2229] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:29:49.952193 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 16541
I20260809 02:29:49.952315 17185 raft_consensus.cc:2258] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:49.953497 17186 ts_tablet_manager.cc:1905] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:49.954686 17185 ts_tablet_manager.cc:1905] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:49.956653 17186 ts_tablet_manager.cc:1918] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:49.956744 17186 log.cc:1196] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/c30dfab30ba1410b91b664662ca079aa
I20260809 02:29:49.957078 17186 ts_tablet_manager.cc:1939] T c30dfab30ba1410b91b664662ca079aa P 534417eb89174eb899356b2f4d309fd2: Deleting consensus metadata
I20260809 02:29:49.958508 16431 catalog_manager.cc:4841] TS 534417eb89174eb899356b2f4d309fd2 (127.21.214.130:35413): tablet c30dfab30ba1410b91b664662ca079aa (table test-table [id=ff6149526539495fbe383441d8f46b00]) successfully deleted
I20260809 02:29:49.959676 17185 ts_tablet_manager.cc:1918] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:49.959813 17185 log.cc:1196] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/c30dfab30ba1410b91b664662ca079aa
I20260809 02:29:49.960338 17185 ts_tablet_manager.cc:1939] T c30dfab30ba1410b91b664662ca079aa P 5e2107697506419dad2c732fde3faad3: Deleting consensus metadata
I20260809 02:29:49.962235 16435 catalog_manager.cc:4841] TS 5e2107697506419dad2c732fde3faad3 (127.21.214.131:45753): tablet c30dfab30ba1410b91b664662ca079aa (table test-table [id=ff6149526539495fbe383441d8f46b00]) successfully deleted
W20260809 02:29:49.971352 16434 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:40479 (error 108)
I20260809 02:29:49.972323 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 16732
I20260809 02:29:49.972635 17140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:49.972290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:40479 (local address 127.0.0.1:44738)
0809 02:29:49.972437 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:49.972523 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:40479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 02:29:49.977886 16434 catalog_manager.cc:4584] TS 60fa9afdb9274150ac59eb5606536e21 (127.21.214.129:40479): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c30dfab30ba1410b91b664662ca079aa: Network error: Client connection negotiation failed: client connection to 127.21.214.129:40479: connect: Connection refused (error 111)
I20260809 02:29:49.995158 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 16925
I20260809 02:29:50.007409 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 16407
2026-08-09T02:29:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2930 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T02:29:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:29:50Z Disabled control of system clock
I20260809 02:29:50.043159 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:40195
--webserver_interface=127.21.214.190
--webserver_port=0
--builtin_ntp_servers=127.21.214.148:41375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:40195
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:29:50.156330 17193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:50.156702 17193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:50.156790 17193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:50.161082 17193 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:29:50.161144 17193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:50.161161 17193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:50.161178 17193 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:29:50.161193 17193 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:29:50.165923 17193 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:40195
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:40195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:50.167090 17193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:50.168514 17193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:50.177265 17203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:50.177248 17200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:50.177244 17201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:50.177520 17193 server_base.cc:1034] running on GCE node
I20260809 02:29:50.178253 17193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:50.179389 17193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:50.180563 17193 hybrid_clock.cc:648] HybridClock initialized: now 1786242590180536 us; error 39 us; skew 500 ppm
I20260809 02:29:50.182507 17193 webserver.cc:460] Webserver started at http://127.21.214.190:39623/ using document root <none> and password file <none>
I20260809 02:29:50.183087 17193 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:50.183151 17193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:50.183411 17193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:50.185482 17193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "0befc96f8209432a9da1d6c23cca859d"
format_stamp: "Formatted at 2026-08-09 02:29:50 on dist-test-slave-68xk"
server_key: "1810197685ce4d65d87971f2911d12fb"
server_key_iv: "e878bc979ffc73ab35778fdd692e61a6"
server_key_version: "encryptionkey@0"
I20260809 02:29:50.186069 17193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "0befc96f8209432a9da1d6c23cca859d"
format_stamp: "Formatted at 2026-08-09 02:29:50 on dist-test-slave-68xk"
server_key: "1810197685ce4d65d87971f2911d12fb"
server_key_iv: "e878bc979ffc73ab35778fdd692e61a6"
server_key_version: "encryptionkey@0"
I20260809 02:29:50.189765 17193 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260809 02:29:50.192204 17213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:50.193424 17193 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:29:50.193568 17193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "0befc96f8209432a9da1d6c23cca859d"
format_stamp: "Formatted at 2026-08-09 02:29:50 on dist-test-slave-68xk"
server_key: "1810197685ce4d65d87971f2911d12fb"
server_key_iv: "e878bc979ffc73ab35778fdd692e61a6"
server_key_version: "encryptionkey@0"
I20260809 02:29:50.193672 17193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:50.206593 17193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:50.207257 17193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:50.207448 17193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:50.214587 17193 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:40195
I20260809 02:29:50.214655 17302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:40195 every 8 connection(s)
I20260809 02:29:50.215535 17193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:29:50.218653 17303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:50.219732 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 17193
I20260809 02:29:50.219862 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:29:50.220232 22362 external_mini_cluster.cc:1428] Setting key 323a335cafe4674ff2535bd8bb3738d1
I20260809 02:29:50.224993 17303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d: Bootstrap starting.
I20260809 02:29:50.227272 17303 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:50.228022 17303 log.cc:824] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:50.229661 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.221697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33658 (local address 127.21.214.190:40195)
0809 02:29:50.222331 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:50.222346 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:50.222381 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:29:50.223087 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:50.223103 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:50.223483 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:50.223824 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:50.224261 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.225264 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.226147 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.226680 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.226859 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.227756 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:50.227761 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:50.227772 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:50.228136 (+ 364us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:50.228234 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:50.228256 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:50.228358 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:50.228528 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 02:29:50.228801 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":125,"threads_started":1}
I20260809 02:29:50.230216 17303 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d: No bootstrap required, opened a new log
I20260809 02:29:50.233816 17303 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0befc96f8209432a9da1d6c23cca859d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40195 } }
I20260809 02:29:50.234014 17303 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:50.234048 17303 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0befc96f8209432a9da1d6c23cca859d, State: Initialized, Role: FOLLOWER
I20260809 02:29:50.234390 17303 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0befc96f8209432a9da1d6c23cca859d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40195 } }
I20260809 02:29:50.234577 17303 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:29:50.234622 17303 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:29:50.234685 17303 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:50.235492 17303 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0befc96f8209432a9da1d6c23cca859d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40195 } }
I20260809 02:29:50.235769 17303 leader_election.cc:302] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0befc96f8209432a9da1d6c23cca859d; no voters:
I20260809 02:29:50.236011 17303 leader_election.cc:288] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:29:50.236158 17310 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:50.236416 17310 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [term 1 LEADER]: Becoming Leader. State: Replica: 0befc96f8209432a9da1d6c23cca859d, State: Running, Role: LEADER
I20260809 02:29:50.236717 17310 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0befc96f8209432a9da1d6c23cca859d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40195 } }
I20260809 02:29:50.237159 17303 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:29:50.238308 17312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0befc96f8209432a9da1d6c23cca859d. Latest consensus state: current_term: 1 leader_uuid: "0befc96f8209432a9da1d6c23cca859d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0befc96f8209432a9da1d6c23cca859d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40195 } } }
I20260809 02:29:50.238461 17312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:50.238669 17311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0befc96f8209432a9da1d6c23cca859d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0befc96f8209432a9da1d6c23cca859d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40195 } } }
I20260809 02:29:50.238863 17311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:50.238880 17320 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:29:50.242005 17320 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:29:50.247040 17320 catalog_manager.cc:1347] Generated new cluster ID: 8c5cca01c812474da6fef5646cbe7fb0
I20260809 02:29:50.247102 17320 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:29:50.265532 17320 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:29:50.266430 17320 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:29:50.276157 17320 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d: Generated new TSK 0
I20260809 02:29:50.276849 17320 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:29:50.279871 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40195
--builtin_ntp_servers=127.21.214.148:41375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:29:50.396013 17333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:50.396281 17333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:50.396320 17333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:50.400569 17333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:50.400625 17333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:50.400679 17333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:29:50.405553 17333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40195
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:50.406713 17333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:50.408149 17333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:29:50.417945 17333 server_base.cc:1034] running on GCE node
W20260809 02:29:50.417909 17342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:50.417909 17344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:50.417979 17341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:50.418706 17333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:50.419415 17333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:50.420585 17333 hybrid_clock.cc:648] HybridClock initialized: now 1786242590420568 us; error 29 us; skew 500 ppm
I20260809 02:29:50.422559 17333 webserver.cc:460] Webserver started at http://127.21.214.129:44453/ using document root <none> and password file <none>
I20260809 02:29:50.423159 17333 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:50.423231 17333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:50.423457 17333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:50.425637 17333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "ef04d72e53d44187a36f5a6489c78689"
format_stamp: "Formatted at 2026-08-09 02:29:50 on dist-test-slave-68xk"
server_key: "ce9fb96557cfa3f4d5f0765b9b768b05"
server_key_iv: "b0fec2e4f095d9e9f717ae1a9234f76a"
server_key_version: "encryptionkey@0"
I20260809 02:29:50.426229 17333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "ef04d72e53d44187a36f5a6489c78689"
format_stamp: "Formatted at 2026-08-09 02:29:50 on dist-test-slave-68xk"
server_key: "ce9fb96557cfa3f4d5f0765b9b768b05"
server_key_iv: "b0fec2e4f095d9e9f717ae1a9234f76a"
server_key_version: "encryptionkey@0"
I20260809 02:29:50.429986 17333 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260809 02:29:50.432610 17354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:50.433885 17333 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 02:29:50.434008 17333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "ef04d72e53d44187a36f5a6489c78689"
format_stamp: "Formatted at 2026-08-09 02:29:50 on dist-test-slave-68xk"
server_key: "ce9fb96557cfa3f4d5f0765b9b768b05"
server_key_iv: "b0fec2e4f095d9e9f717ae1a9234f76a"
server_key_version: "encryptionkey@0"
I20260809 02:29:50.434119 17333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:50.453321 17333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:50.454068 17333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:50.454294 17333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:50.454979 17333 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:50.456037 17333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:50.456123 17333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:50.456192 17333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:50.456233 17333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:50.465953 17333 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:44417
I20260809 02:29:50.466006 17513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:44417 every 8 connection(s)
I20260809 02:29:50.466930 17333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:29:50.469197 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 17333
I20260809 02:29:50.469341 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:29:50.469655 22362 external_mini_cluster.cc:1428] Setting key e4b5934f7de589deffda5c71b15ca12f
I20260809 02:29:50.471762 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40195
--builtin_ntp_servers=127.21.214.148:41375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:29:50.477638 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.468864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:57545 (local address 127.21.214.190:40195)
0809 02:29:50.469056 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:50.469061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:50.470246 (+ 1185us) server_negotiation.cc:407] Connection header received
0809 02:29:50.472204 (+ 1958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:50.472208 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:50.472273 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:50.472372 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:50.473361 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.473968 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.475389 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.475661 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.475788 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.477062 (+ 1274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:50.477067 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:50.477070 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:50.477085 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:50.477118 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:50.477128 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:50.477219 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:50.477397 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 02:29:50.477476 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 02:29:50.478901 17516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.469271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40195 (local address 127.21.214.129:57545)
0809 02:29:50.470088 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:50.470141 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:50.471810 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:50.472572 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:50.472580 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:50.472672 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:50.473196 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.473210 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.474137 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.474142 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.475213 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.475224 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.475832 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.475837 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.476025 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.476761 (+ 736us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:29:50.476763 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:50.476807 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:29:50.476876 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:50.477221 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:50.477235 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:50.477244 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 02:29:50.477396 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 02:29:50.477712 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":163,"threads_started":1}
I20260809 02:29:50.480365 17514 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40195
I20260809 02:29:50.480648 17514 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:50.481245 17514 heartbeater.cc:511] Master 127.21.214.190:40195 requested a full tablet report, sending...
I20260809 02:29:50.482965 17236 ts_manager.cc:194] Registered new tserver with Master: ef04d72e53d44187a36f5a6489c78689 (127.21.214.129:44417)
I20260809 02:29:50.484131 17236 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.214.129:57545
W20260809 02:29:50.586639 17517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:50.586923 17517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:50.586992 17517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:50.591087 17517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:50.591177 17517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:50.591274 17517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:29:50.596109 17517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40195
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:50.597333 17517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:50.598876 17517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:50.608439 17530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:50.608474 17528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:50.608439 17527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:50.608809 17517 server_base.cc:1034] running on GCE node
I20260809 02:29:50.609167 17517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:50.609791 17517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:50.610956 17517 hybrid_clock.cc:648] HybridClock initialized: now 1786242590610919 us; error 53 us; skew 500 ppm
I20260809 02:29:50.612803 17517 webserver.cc:460] Webserver started at http://127.21.214.130:41581/ using document root <none> and password file <none>
I20260809 02:29:50.613394 17517 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:50.613458 17517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:50.613673 17517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:50.615801 17517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "7d111b5840c54547821086fa8104c895"
format_stamp: "Formatted at 2026-08-09 02:29:50 on dist-test-slave-68xk"
server_key: "edf3ec46dab9d76563cb5280db0ab53e"
server_key_iv: "26e273679d7e9259219e5ef4c915b416"
server_key_version: "encryptionkey@0"
I20260809 02:29:50.616372 17517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "7d111b5840c54547821086fa8104c895"
format_stamp: "Formatted at 2026-08-09 02:29:50 on dist-test-slave-68xk"
server_key: "edf3ec46dab9d76563cb5280db0ab53e"
server_key_iv: "26e273679d7e9259219e5ef4c915b416"
server_key_version: "encryptionkey@0"
I20260809 02:29:50.620275 17517 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 02:29:50.622896 17536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:50.624166 17517 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:29:50.624320 17517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "7d111b5840c54547821086fa8104c895"
format_stamp: "Formatted at 2026-08-09 02:29:50 on dist-test-slave-68xk"
server_key: "edf3ec46dab9d76563cb5280db0ab53e"
server_key_iv: "26e273679d7e9259219e5ef4c915b416"
server_key_version: "encryptionkey@0"
I20260809 02:29:50.624436 17517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:50.650274 17517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:50.651018 17517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:50.651254 17517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:50.651875 17517 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:50.652837 17517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:50.652912 17517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:50.652978 17517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:50.653031 17517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:50.663157 17517 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:41321
I20260809 02:29:50.663206 17703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:41321 every 8 connection(s)
I20260809 02:29:50.664060 17517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:29:50.669469 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 17517
I20260809 02:29:50.669559 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:29:50.669875 22362 external_mini_cluster.cc:1428] Setting key c7d9c66cf093fd4f49e178aaf1209f14
I20260809 02:29:50.671872 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40195
--builtin_ntp_servers=127.21.214.148:41375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:29:50.673816 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.666041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:44907 (local address 127.21.214.190:40195)
0809 02:29:50.666203 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:50.666207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:50.667341 (+ 1134us) server_negotiation.cc:407] Connection header received
0809 02:29:50.668672 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:50.668674 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:50.668719 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:50.668796 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:50.669810 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.670448 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.671778 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.672057 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.672156 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.673302 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:50.673306 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:50.673309 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:50.673321 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:50.673344 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:50.673360 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:50.673441 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:50.673614 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 02:29:50.673678 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 02:29:50.674718 17706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.666457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40195 (local address 127.21.214.130:44907)
0809 02:29:50.667192 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:50.667234 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:50.668487 (+ 1253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:50.668963 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:50.668970 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:50.669048 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:50.669652 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.669669 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.670592 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.670598 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.671636 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.671646 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.672198 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.672201 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.672366 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.673038 (+ 672us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:29:50.673039 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:50.673085 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:29:50.673144 (+ 59us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:50.673444 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:50.673456 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:50.673464 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 02:29:50.673603 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 02:29:50.673866 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":114,"threads_started":1}
I20260809 02:29:50.675848 17704 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40195
I20260809 02:29:50.676096 17704 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:50.676750 17704 heartbeater.cc:511] Master 127.21.214.190:40195 requested a full tablet report, sending...
I20260809 02:29:50.677937 17236 ts_manager.cc:194] Registered new tserver with Master: 7d111b5840c54547821086fa8104c895 (127.21.214.130:41321)
I20260809 02:29:50.678593 17236 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.214.130:44907
W20260809 02:29:50.789933 17707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:50.790196 17707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:50.790269 17707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:50.794332 17707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:50.794392 17707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:50.794552 17707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:29:50.799575 17707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40195
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:50.800690 17707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:50.802125 17707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:50.811918 17716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:50.811883 17723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:50.811903 17718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:50.812235 17707 server_base.cc:1034] running on GCE node
I20260809 02:29:50.812613 17707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:50.813259 17707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:50.814472 17707 hybrid_clock.cc:648] HybridClock initialized: now 1786242590814450 us; error 30 us; skew 500 ppm
I20260809 02:29:50.816306 17707 webserver.cc:460] Webserver started at http://127.21.214.131:35251/ using document root <none> and password file <none>
I20260809 02:29:50.816906 17707 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:50.817004 17707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:50.817255 17707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:50.819368 17707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "a4f12bda2f94454c976daf4b01ec53c9"
format_stamp: "Formatted at 2026-08-09 02:29:50 on dist-test-slave-68xk"
server_key: "edf42e4d1fb452d521a801f1b5b6670d"
server_key_iv: "ec055fa4baee08d5b9838104507266fa"
server_key_version: "encryptionkey@0"
I20260809 02:29:50.819962 17707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "a4f12bda2f94454c976daf4b01ec53c9"
format_stamp: "Formatted at 2026-08-09 02:29:50 on dist-test-slave-68xk"
server_key: "edf42e4d1fb452d521a801f1b5b6670d"
server_key_iv: "ec055fa4baee08d5b9838104507266fa"
server_key_version: "encryptionkey@0"
I20260809 02:29:50.823779 17707 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:29:50.826228 17730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:50.827543 17707 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:29:50.827677 17707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "a4f12bda2f94454c976daf4b01ec53c9"
format_stamp: "Formatted at 2026-08-09 02:29:50 on dist-test-slave-68xk"
server_key: "edf42e4d1fb452d521a801f1b5b6670d"
server_key_iv: "ec055fa4baee08d5b9838104507266fa"
server_key_version: "encryptionkey@0"
I20260809 02:29:50.827792 17707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:50.847319 17707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:50.848070 17707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:50.848292 17707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:50.848918 17707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:50.849969 17707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:50.850044 17707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:50.850118 17707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:50.850170 17707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:50.859829 17707 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:36975
I20260809 02:29:50.859885 17895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:36975 every 8 connection(s)
I20260809 02:29:50.860752 17707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:29:50.870283 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 17707
I20260809 02:29:50.870453 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:29:50.870820 22362 external_mini_cluster.cc:1428] Setting key c7de0467359e78ff0b822bdb9f9c4d27
I20260809 02:29:50.870946 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.862728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:42167 (local address 127.21.214.190:40195)
0809 02:29:50.862885 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:50.862889 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:50.864043 (+ 1154us) server_negotiation.cc:407] Connection header received
0809 02:29:50.865651 (+ 1608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:50.865655 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:50.865719 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:50.865839 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:50.866840 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.867431 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.868696 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.868953 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.869081 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.870324 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:50.870329 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:50.870331 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:50.870352 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:50.870374 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:50.870383 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:50.870520 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:50.870731 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 02:29:50.870791 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 02:29:50.871970 17900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.863147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40195 (local address 127.21.214.131:42167)
0809 02:29:50.863869 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:50.863914 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:50.865406 (+ 1492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:50.866029 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:50.866036 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:50.866127 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:50.866678 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.866692 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.867578 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.867587 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.868553 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.868563 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.869128 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.869133 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.869319 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.870034 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:29:50.870036 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:50.870078 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:29:50.870150 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:50.870529 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:50.870540 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:50.870547 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 02:29:50.870711 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 02:29:50.871023 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":116,"threads_started":1}
I20260809 02:29:50.873195 17896 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40195
I20260809 02:29:50.873432 17896 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:50.873911 17896 heartbeater.cc:511] Master 127.21.214.190:40195 requested a full tablet report, sending...
I20260809 02:29:50.874965 17236 ts_manager.cc:194] Registered new tserver with Master: a4f12bda2f94454c976daf4b01ec53c9 (127.21.214.131:36975)
I20260809 02:29:50.875602 17236 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.214.131:42167
I20260809 02:29:50.884996 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:29:50.890852 17307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.887127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33672 (local address 127.21.214.190:40195)
0809 02:29:50.887369 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:50.887373 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:50.887444 (+ 71us) server_negotiation.cc:407] Connection header received
0809 02:29:50.887544 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:50.887546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:50.887585 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:50.887665 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:50.887919 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.888435 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.889237 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.889440 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.889514 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.890382 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:50.890385 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:50.890387 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:50.890397 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:50.890456 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:50.890468 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:50.890578 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:50.890709 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 02:29:50.890745 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160}
I20260809 02:29:50.894095 17236 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33672:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:29:50.897286 17236 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:29:50.912869 17920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.907412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49394 (local address 127.21.214.130:41321)
0809 02:29:50.907824 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:50.907836 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:50.908205 (+ 369us) server_negotiation.cc:407] Connection header received
0809 02:29:50.908289 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:50.908294 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:50.908484 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:50.908611 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:50.908931 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.909691 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.911550 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.912145 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.912298 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.912492 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:50.912599 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 02:29:50.912712 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":136,"threads_started":1}
I20260809 02:29:50.912969 17912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.906471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:36975 (local address 127.0.0.1:47388)
0809 02:29:50.906841 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:50.906894 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:50.907035 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:50.908225 (+ 1190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:50.908232 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:50.908255 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:50.908405 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.908412 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.910076 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.910080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.911425 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.911432 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.912536 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.912539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.912626 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.912647 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 02:29:50.912700 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 02:29:50.912786 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":125,"thread_start_us":99,"threads_started":1}
I20260809 02:29:50.913134 17916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.906895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:44417 (local address 127.0.0.1:54918)
0809 02:29:50.907951 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:50.907965 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:50.908076 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:50.908502 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:50.908505 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:50.908522 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:50.908643 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.908654 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.910076 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.910080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.911464 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.911475 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.912767 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.912770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.912857 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.912884 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 02:29:50.912951 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 02:29:50.913011 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":991,"mutex_wait_us":392,"thread_start_us":123,"threads_started":1}
I20260809 02:29:50.913473 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.906647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47388 (local address 127.21.214.131:36975)
0809 02:29:50.907666 (+ 1019us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:50.907680 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:50.907708 (+ 28us) server_negotiation.cc:407] Connection header received
0809 02:29:50.907794 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:50.907799 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:50.908032 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:50.908567 (+ 535us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:50.908718 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.909937 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.911570 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.912392 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.912971 (+ 579us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.913143 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:50.913197 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 02:29:50.913310 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":900,"thread_start_us":192,"threads_started":1}
I20260809 02:29:50.912863 17917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.907248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:41321 (local address 127.0.0.1:49394)
0809 02:29:50.907960 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:50.907972 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:50.908105 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:50.908694 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:50.908699 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:50.908721 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:50.908802 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.908807 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.909818 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.909825 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.911414 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.911426 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.912305 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.912309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.912412 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.912449 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 02:29:50.912569 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 02:29:50.912696 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":25,"thread_start_us":101,"threads_started":1}
I20260809 02:29:50.913800 17919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.907363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54918 (local address 127.21.214.129:44417)
0809 02:29:50.907817 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:50.907830 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:50.908092 (+ 262us) server_negotiation.cc:407] Connection header received
0809 02:29:50.908187 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:50.908194 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:50.908358 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:50.908529 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:50.908789 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.909953 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.911598 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.912392 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.912530 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.912706 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:50.913332 (+ 626us) server_negotiation.cc:299] Negotiation successful
0809 02:29:50.913435 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":107,"threads_started":1}
I20260809 02:29:50.916479 17417 tablet_service.cc:1467] Processing CreateTablet for tablet 5981c0bc375244149b2381187640287d (DEFAULT_TABLE table=test-table [id=1b0b1a744eb54c17a7a3b07a7cf7b5f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:50.916621 17608 tablet_service.cc:1467] Processing CreateTablet for tablet 5981c0bc375244149b2381187640287d (DEFAULT_TABLE table=test-table [id=1b0b1a744eb54c17a7a3b07a7cf7b5f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:50.916621 17797 tablet_service.cc:1467] Processing CreateTablet for tablet 5981c0bc375244149b2381187640287d (DEFAULT_TABLE table=test-table [id=1b0b1a744eb54c17a7a3b07a7cf7b5f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:50.917629 17417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5981c0bc375244149b2381187640287d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:50.917645 17797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5981c0bc375244149b2381187640287d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:50.917645 17608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5981c0bc375244149b2381187640287d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:50.924015 17921 tablet_bootstrap.cc:492] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689: Bootstrap starting.
I20260809 02:29:50.925302 17924 tablet_bootstrap.cc:492] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895: Bootstrap starting.
I20260809 02:29:50.925602 17923 tablet_bootstrap.cc:492] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9: Bootstrap starting.
I20260809 02:29:50.926731 17921 tablet_bootstrap.cc:654] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:50.927475 17923 tablet_bootstrap.cc:654] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:50.927497 17924 tablet_bootstrap.cc:654] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:50.927677 17921 log.cc:824] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:50.928373 17924 log.cc:824] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:50.928468 17923 log.cc:824] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:50.930197 17921 tablet_bootstrap.cc:492] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689: No bootstrap required, opened a new log
I20260809 02:29:50.930429 17921 ts_tablet_manager.cc:1397] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 02:29:50.930539 17924 tablet_bootstrap.cc:492] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895: No bootstrap required, opened a new log
I20260809 02:29:50.930739 17924 ts_tablet_manager.cc:1397] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:29:50.931615 17923 tablet_bootstrap.cc:492] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9: No bootstrap required, opened a new log
I20260809 02:29:50.931854 17923 ts_tablet_manager.cc:1397] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 02:29:50.934978 17924 raft_consensus.cc:348] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4f12bda2f94454c976daf4b01ec53c9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36975 } } peers { permanent_uuid: "7d111b5840c54547821086fa8104c895" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41321 } } peers { permanent_uuid: "ef04d72e53d44187a36f5a6489c78689" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 44417 } }
I20260809 02:29:50.934978 17921 raft_consensus.cc:348] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4f12bda2f94454c976daf4b01ec53c9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36975 } } peers { permanent_uuid: "7d111b5840c54547821086fa8104c895" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41321 } } peers { permanent_uuid: "ef04d72e53d44187a36f5a6489c78689" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 44417 } }
I20260809 02:29:50.935256 17924 raft_consensus.cc:374] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:50.935312 17924 raft_consensus.cc:729] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d111b5840c54547821086fa8104c895, State: Initialized, Role: FOLLOWER
I20260809 02:29:50.935320 17921 raft_consensus.cc:374] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:50.935382 17921 raft_consensus.cc:729] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef04d72e53d44187a36f5a6489c78689, State: Initialized, Role: FOLLOWER
I20260809 02:29:50.935734 17923 raft_consensus.cc:348] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4f12bda2f94454c976daf4b01ec53c9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36975 } } peers { permanent_uuid: "7d111b5840c54547821086fa8104c895" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41321 } } peers { permanent_uuid: "ef04d72e53d44187a36f5a6489c78689" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 44417 } }
I20260809 02:29:50.935863 17924 consensus_queue.cc:260] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4f12bda2f94454c976daf4b01ec53c9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36975 } } peers { permanent_uuid: "7d111b5840c54547821086fa8104c895" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41321 } } peers { permanent_uuid: "ef04d72e53d44187a36f5a6489c78689" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 44417 } }
I20260809 02:29:50.935863 17921 consensus_queue.cc:260] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4f12bda2f94454c976daf4b01ec53c9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36975 } } peers { permanent_uuid: "7d111b5840c54547821086fa8104c895" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41321 } } peers { permanent_uuid: "ef04d72e53d44187a36f5a6489c78689" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 44417 } }
I20260809 02:29:50.936002 17923 raft_consensus.cc:374] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:50.936060 17923 raft_consensus.cc:729] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4f12bda2f94454c976daf4b01ec53c9, State: Initialized, Role: FOLLOWER
I20260809 02:29:50.936486 17923 consensus_queue.cc:260] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4f12bda2f94454c976daf4b01ec53c9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36975 } } peers { permanent_uuid: "7d111b5840c54547821086fa8104c895" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41321 } } peers { permanent_uuid: "ef04d72e53d44187a36f5a6489c78689" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 44417 } }
I20260809 02:29:50.936609 17704 heartbeater.cc:503] Master 127.21.214.190:40195 was elected leader, sending a full tablet report...
I20260809 02:29:50.936868 17924 ts_tablet_manager.cc:1428] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:29:50.936919 17921 ts_tablet_manager.cc:1428] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:29:50.937266 17514 heartbeater.cc:503] Master 127.21.214.190:40195 was elected leader, sending a full tablet report...
I20260809 02:29:50.937448 17923 ts_tablet_manager.cc:1428] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 02:29:50.937669 17896 heartbeater.cc:503] Master 127.21.214.190:40195 was elected leader, sending a full tablet report...
W20260809 02:29:50.968163 17515 tablet.cc:2369] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:29:50.979929 17929 raft_consensus.cc:482] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:29:50.980119 17929 raft_consensus.cc:504] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4f12bda2f94454c976daf4b01ec53c9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36975 } } peers { permanent_uuid: "7d111b5840c54547821086fa8104c895" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41321 } } peers { permanent_uuid: "ef04d72e53d44187a36f5a6489c78689" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 44417 } }
I20260809 02:29:50.981292 17929 leader_election.cc:288] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4f12bda2f94454c976daf4b01ec53c9 (127.21.214.131:36975), 7d111b5840c54547821086fa8104c895 (127.21.214.130:41321)
I20260809 02:29:50.985960 17920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.982226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:57205 (local address 127.21.214.130:41321)
0809 02:29:50.982384 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:50.982389 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:50.982506 (+ 117us) server_negotiation.cc:407] Connection header received
0809 02:29:50.982806 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:50.982810 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:50.982867 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:50.982955 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:50.983248 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.983836 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.984889 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.985312 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.985477 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.985532 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:50.985758 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 02:29:50.985832 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 02:29:50.985954 17915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.981652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:43267 (local address 127.21.214.131:36975)
0809 02:29:50.981860 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:50.981865 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:50.982003 (+ 138us) server_negotiation.cc:407] Connection header received
0809 02:29:50.982233 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:50.982236 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:50.982314 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:50.982394 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:50.982822 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.983637 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.984835 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.985309 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.985456 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.985513 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:50.985731 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 02:29:50.985809 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 02:29:50.985980 17932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.981505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:36975 (local address 127.21.214.129:43267)
0809 02:29:50.981887 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:50.981912 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:50.982067 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:50.982492 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:50.982498 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:50.982520 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:50.982701 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.982712 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.983765 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.983770 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.984690 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.984700 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.985446 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.985450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.985567 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.985599 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 02:29:50.985713 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 02:29:50.985795 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"spinlock_wait_cycles":18816,"thread_start_us":139,"threads_started":1}
I20260809 02:29:50.985983 17933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:50.982013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:41321 (local address 127.21.214.129:57205)
0809 02:29:50.982390 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:50.982431 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:50.982590 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:50.982969 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:50.982972 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:50.982989 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:50.983123 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.983128 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.983956 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.983960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.984756 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:50.984765 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:50.985478 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:50.985514 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:50.985625 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:50.985644 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 02:29:50.985739 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 02:29:50.985813 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"spinlock_wait_cycles":2688,"thread_start_us":144,"threads_started":1}
I20260809 02:29:50.986909 17828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5981c0bc375244149b2381187640287d" candidate_uuid: "ef04d72e53d44187a36f5a6489c78689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4f12bda2f94454c976daf4b01ec53c9" is_pre_election: true
I20260809 02:29:50.987048 17637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5981c0bc375244149b2381187640287d" candidate_uuid: "ef04d72e53d44187a36f5a6489c78689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d111b5840c54547821086fa8104c895" is_pre_election: true
I20260809 02:29:50.987270 17828 raft_consensus.cc:2454] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef04d72e53d44187a36f5a6489c78689 in term 0.
I20260809 02:29:50.987404 17637 raft_consensus.cc:2454] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef04d72e53d44187a36f5a6489c78689 in term 0.
I20260809 02:29:50.987864 17355 leader_election.cc:302] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4f12bda2f94454c976daf4b01ec53c9, ef04d72e53d44187a36f5a6489c78689; no voters:
I20260809 02:29:50.988133 17929 raft_consensus.cc:2781] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:29:50.988231 17929 raft_consensus.cc:482] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:29:50.988291 17929 raft_consensus.cc:3037] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:50.989372 17929 raft_consensus.cc:504] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4f12bda2f94454c976daf4b01ec53c9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36975 } } peers { permanent_uuid: "7d111b5840c54547821086fa8104c895" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41321 } } peers { permanent_uuid: "ef04d72e53d44187a36f5a6489c78689" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 44417 } }
I20260809 02:29:50.989708 17929 leader_election.cc:288] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [CANDIDATE]: Term 1 election: Requested vote from peers a4f12bda2f94454c976daf4b01ec53c9 (127.21.214.131:36975), 7d111b5840c54547821086fa8104c895 (127.21.214.130:41321)
I20260809 02:29:50.990067 17828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5981c0bc375244149b2381187640287d" candidate_uuid: "ef04d72e53d44187a36f5a6489c78689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4f12bda2f94454c976daf4b01ec53c9"
I20260809 02:29:50.990097 17637 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5981c0bc375244149b2381187640287d" candidate_uuid: "ef04d72e53d44187a36f5a6489c78689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d111b5840c54547821086fa8104c895"
I20260809 02:29:50.990180 17828 raft_consensus.cc:3037] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:50.990234 17637 raft_consensus.cc:3037] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:50.991271 17828 raft_consensus.cc:2454] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef04d72e53d44187a36f5a6489c78689 in term 1.
I20260809 02:29:50.991504 17637 raft_consensus.cc:2454] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef04d72e53d44187a36f5a6489c78689 in term 1.
I20260809 02:29:50.991568 17355 leader_election.cc:302] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4f12bda2f94454c976daf4b01ec53c9, ef04d72e53d44187a36f5a6489c78689; no voters:
I20260809 02:29:50.991801 17929 raft_consensus.cc:2781] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:50.992038 17929 raft_consensus.cc:686] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [term 1 LEADER]: Becoming Leader. State: Replica: ef04d72e53d44187a36f5a6489c78689, State: Running, Role: LEADER
I20260809 02:29:50.992373 17929 consensus_queue.cc:237] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4f12bda2f94454c976daf4b01ec53c9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36975 } } peers { permanent_uuid: "7d111b5840c54547821086fa8104c895" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41321 } } peers { permanent_uuid: "ef04d72e53d44187a36f5a6489c78689" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 44417 } }
I20260809 02:29:50.995594 17234 catalog_manager.cc:5495] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef04d72e53d44187a36f5a6489c78689 (127.21.214.129). New cstate: current_term: 1 leader_uuid: "ef04d72e53d44187a36f5a6489c78689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a4f12bda2f94454c976daf4b01ec53c9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d111b5840c54547821086fa8104c895" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef04d72e53d44187a36f5a6489c78689" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260809 02:29:51.013783 17919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:51.009583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54934 (local address 127.21.214.129:44417)
0809 02:29:51.009778 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:51.009784 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:51.009801 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:29:51.009884 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:51.009892 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:51.009993 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:51.010120 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:29:51.010519 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:51.011083 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:51.012288 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:51.012581 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:51.012667 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:51.012936 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:29:51.013341 (+ 405us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:29:51.013451 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:51.013600 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 02:29:51.013639 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260809 02:29:51.019809 17828 raft_consensus.cc:1261] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9 [term 1 FOLLOWER]: Refusing update from remote peer ef04d72e53d44187a36f5a6489c78689: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:51.019804 17637 raft_consensus.cc:1261] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895 [term 1 FOLLOWER]: Refusing update from remote peer ef04d72e53d44187a36f5a6489c78689: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:51.020602 17935 consensus_queue.cc:1035] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4f12bda2f94454c976daf4b01ec53c9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 36975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:51.020829 17929 consensus_queue.cc:1035] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d111b5840c54547821086fa8104c895" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:51.028712 17945 mvcc.cc:205] Tried to move back new op lower bound from 7316449652809195520 to 7316449652707389440. Current Snapshot: MvccSnapshot[applied={T|T < 7316449652809195520}]
I20260809 02:29:51.029608 17943 mvcc.cc:205] Tried to move back new op lower bound from 7316449652809195520 to 7316449652707389440. Current Snapshot: MvccSnapshot[applied={T|T < 7316449652809195520}]
I20260809 02:29:51.037184 17232 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:51.037392 17232 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33672:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:51.039992 17232 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0befc96f8209432a9da1d6c23cca859d: Sending DeleteTablet for 3 replicas of tablet 5981c0bc375244149b2381187640287d
I20260809 02:29:51.040828 17417 tablet_service.cc:1514] Processing DeleteTablet for tablet 5981c0bc375244149b2381187640287d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:51 UTC) from {username='slave'} at 127.0.0.1:54918
I20260809 02:29:51.040843 17797 tablet_service.cc:1514] Processing DeleteTablet for tablet 5981c0bc375244149b2381187640287d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:51 UTC) from {username='slave'} at 127.0.0.1:47388
I20260809 02:29:51.040957 17608 tablet_service.cc:1514] Processing DeleteTablet for tablet 5981c0bc375244149b2381187640287d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:51 UTC) from {username='slave'} at 127.0.0.1:49394
I20260809 02:29:51.041357 17954 tablet_replica.cc:330] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689: stopping tablet replica
I20260809 02:29:51.041370 17956 tablet_replica.cc:330] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9: stopping tablet replica
I20260809 02:29:51.041716 17954 raft_consensus.cc:2229] T 5981c0bc375244149b2381187640287d P ef04d72e53d44187a36f5a6489c78689 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:29:51.041718 17956 raft_consensus.cc:2229] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:29:51.041805 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 17333
I20260809 02:29:51.044773 17956 raft_consensus.cc:2258] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:51.045261 17957 tablet_replica.cc:330] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895: stopping tablet replica
I20260809 02:29:51.045655 17957 raft_consensus.cc:2229] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:29:51.046005 17957 raft_consensus.cc:2258] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:51.048785 17957 ts_tablet_manager.cc:1905] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:51.049140 17956 ts_tablet_manager.cc:1905] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:51.051448 17956 ts_tablet_manager.cc:1918] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:51.051591 17956 log.cc:1196] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/5981c0bc375244149b2381187640287d
I20260809 02:29:51.051925 17956 ts_tablet_manager.cc:1939] T 5981c0bc375244149b2381187640287d P a4f12bda2f94454c976daf4b01ec53c9: Deleting consensus metadata
I20260809 02:29:51.052444 17957 ts_tablet_manager.cc:1918] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:51.052551 17957 log.cc:1196] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/5981c0bc375244149b2381187640287d
I20260809 02:29:51.052868 17957 ts_tablet_manager.cc:1939] T 5981c0bc375244149b2381187640287d P 7d111b5840c54547821086fa8104c895: Deleting consensus metadata
I20260809 02:29:51.053241 17214 catalog_manager.cc:4841] TS a4f12bda2f94454c976daf4b01ec53c9 (127.21.214.131:36975): tablet 5981c0bc375244149b2381187640287d (table test-table [id=1b0b1a744eb54c17a7a3b07a7cf7b5f4]) successfully deleted
I20260809 02:29:51.054102 17214 catalog_manager.cc:4841] TS 7d111b5840c54547821086fa8104c895 (127.21.214.130:41321): tablet 5981c0bc375244149b2381187640287d (table test-table [id=1b0b1a744eb54c17a7a3b07a7cf7b5f4]) successfully deleted
W20260809 02:29:51.057655 17217 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:44417 (error 108)
I20260809 02:29:51.057888 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 17517
I20260809 02:29:51.065024 17917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:51.062122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:44417 (local address 127.0.0.1:54948)
0809 02:29:51.064839 (+ 2717us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:51.064921 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:44417: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2602}
W20260809 02:29:51.065336 17217 catalog_manager.cc:4584] TS ef04d72e53d44187a36f5a6489c78689 (127.21.214.129:44417): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5981c0bc375244149b2381187640287d: Network error: Client connection negotiation failed: client connection to 127.21.214.129:44417: connect: Connection refused (error 111)
I20260809 02:29:51.074679 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 17707
I20260809 02:29:51.084933 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 17193
2026-08-09T02:29:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1081 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:29:51 dist-test-slave-68xk krb5kdc[17962](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:29:51 dist-test-slave-68xk krb5kdc[17962](info): set up 2 sockets
Aug 09 02:29:51 dist-test-slave-68xk krb5kdc[17962](info): commencing operation
krb5kdc: starting...
W20260809 02:29:52.318327 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:29:52 dist-test-slave-68xk krb5kdc[17962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242592, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:29:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:29:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:29:52.454524 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:40277
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:44111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:40277
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:52.567168 17984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:52.567461 17984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:52.567529 17984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:52.571516 17984 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:29:52.571596 17984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:52.571635 17984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:52.571673 17984 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:29:52.571703 17984 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:29:52.576869 17984 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:44111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:40277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:40277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:52.577913 17984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:52.578960 17984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:52.587857 17991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:52.587858 17994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:52.588037 17984 server_base.cc:1034] running on GCE node
W20260809 02:29:52.587857 17990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:52.588858 17984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:52.590011 17984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:52.591212 17984 hybrid_clock.cc:648] HybridClock initialized: now 1786242592591176 us; error 48 us; skew 500 ppm
Aug 09 02:29:52 dist-test-slave-68xk krb5kdc[17962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242592, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:52.599416 17984 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:29:52.600325 17984 webserver.cc:460] Webserver started at http://127.21.214.190:39411/ using document root <none> and password file <none>
I20260809 02:29:52.600917 17984 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:52.600980 17984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:52.601219 17984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:52.603358 17984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "44130c140f1644ad828db0783e4db14b"
format_stamp: "Formatted at 2026-08-09 02:29:52 on dist-test-slave-68xk"
server_key: "fb3438847cd49d7c80b1799e5411dc12"
server_key_iv: "1c02e58e91e9fcfd0e75acdccc0767b8"
server_key_version: "encryptionkey@0"
I20260809 02:29:52.603938 17984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "44130c140f1644ad828db0783e4db14b"
format_stamp: "Formatted at 2026-08-09 02:29:52 on dist-test-slave-68xk"
server_key: "fb3438847cd49d7c80b1799e5411dc12"
server_key_iv: "1c02e58e91e9fcfd0e75acdccc0767b8"
server_key_version: "encryptionkey@0"
I20260809 02:29:52.607656 17984 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:29:52.610183 18004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:52.611415 17984 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:29:52.611549 17984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "44130c140f1644ad828db0783e4db14b"
format_stamp: "Formatted at 2026-08-09 02:29:52 on dist-test-slave-68xk"
server_key: "fb3438847cd49d7c80b1799e5411dc12"
server_key_iv: "1c02e58e91e9fcfd0e75acdccc0767b8"
server_key_version: "encryptionkey@0"
I20260809 02:29:52.611655 17984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:52.624509 17984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:52.627492 17984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:52.627705 17984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:52.635161 17984 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:40277
I20260809 02:29:52.635239 18078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:40277 every 8 connection(s)
I20260809 02:29:52.636078 17984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:29:52.638985 18079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:52.641193 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 17984
I20260809 02:29:52.641350 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:29:52.641687 22362 external_mini_cluster.cc:1428] Setting key d11e12ae56feb756aa9b53b47e3bf638
I20260809 02:29:52.646044 18079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b: Bootstrap starting.
I20260809 02:29:52.648486 18079 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:52.649428 18079 log.cc:824] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:29:52 dist-test-slave-68xk krb5kdc[17962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242592, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:29:52.651813 18079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b: No bootstrap required, opened a new log
I20260809 02:29:52.656319 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:52.643242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44958 (local address 127.21.214.190:40277)
0809 02:29:52.643696 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:52.643711 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:52.643745 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:29:52.644390 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:52.644406 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:52.644715 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:52.645064 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:52.645878 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:52.646964 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:52.647819 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:52.648280 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:52.648451 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:52.651458 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:52.651463 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:52.651476 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:52.651502 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:52.653223 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:52.653826 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:52.653832 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:52.653836 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:52.653952 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:52.654298 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:52.654300 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:52.654301 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:52.654757 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:52.654917 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:52.655275 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 02:29:52.655600 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":156,"threads_started":1}
I20260809 02:29:52.656183 18079 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44130c140f1644ad828db0783e4db14b" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40277 } }
I20260809 02:29:52.656490 18079 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:52.656589 18079 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44130c140f1644ad828db0783e4db14b, State: Initialized, Role: FOLLOWER
I20260809 02:29:52.657048 18079 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44130c140f1644ad828db0783e4db14b" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40277 } }
I20260809 02:29:52.657255 18079 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:29:52.657343 18079 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:29:52.657470 18079 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:52.658696 18079 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44130c140f1644ad828db0783e4db14b" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40277 } }
I20260809 02:29:52.659078 18079 leader_election.cc:302] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44130c140f1644ad828db0783e4db14b; no voters:
I20260809 02:29:52.659413 18079 leader_election.cc:288] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:29:52.659533 18085 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:52.659785 18085 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [term 1 LEADER]: Becoming Leader. State: Replica: 44130c140f1644ad828db0783e4db14b, State: Running, Role: LEADER
I20260809 02:29:52.660164 18085 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44130c140f1644ad828db0783e4db14b" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40277 } }
I20260809 02:29:52.660743 18079 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:29:52.662081 18086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44130c140f1644ad828db0783e4db14b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44130c140f1644ad828db0783e4db14b" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40277 } } }
I20260809 02:29:52.662235 18086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:52.662585 18090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44130c140f1644ad828db0783e4db14b. Latest consensus state: current_term: 1 leader_uuid: "44130c140f1644ad828db0783e4db14b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44130c140f1644ad828db0783e4db14b" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 40277 } } }
I20260809 02:29:52.662703 18090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:52.663923 18103 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:29:52.666754 18103 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:29:52.672377 18103 catalog_manager.cc:1347] Generated new cluster ID: 55e4c01224214644a46c3b0ef2db6b2e
I20260809 02:29:52.672453 18103 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:29:52.695636 18103 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:29:52.696949 18103 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:29:52.707283 18103 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b: Generated new TSK 0
I20260809 02:29:52.708130 18103 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.21.214.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
Entry for principal kudu/127.21.214.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab.
I20260809 02:29:52.739738 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40277
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:44111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:52.867476 18118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:52.867789 18118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:52.867839 18118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:52.872221 18118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:52.872282 18118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:52.872341 18118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:29:52.877666 18118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:44111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.129.keytab
--principal=kudu/127.21.214.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:52.878926 18118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:52.880048 18118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:52.890609 18134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:52.890625 18131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:52.890743 18118 server_base.cc:1034] running on GCE node
W20260809 02:29:52.890666 18128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:52.891775 18118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:52.892535 18118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:52.893775 18118 hybrid_clock.cc:648] HybridClock initialized: now 1786242592893739 us; error 49 us; skew 500 ppm
Aug 09 02:29:52 dist-test-slave-68xk krb5kdc[17962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242592, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:52.897002 18118 init.cc:377] Logged in from keytab as kudu/127.21.214.129@KRBTEST.COM (short username kudu)
I20260809 02:29:52.897979 18118 webserver.cc:460] Webserver started at http://127.21.214.129:44625/ using document root <none> and password file <none>
I20260809 02:29:52.898696 18118 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:52.898798 18118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:52.899049 18118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:52.901234 18118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "5e31e21548f0430da627eaac79dfccc7"
format_stamp: "Formatted at 2026-08-09 02:29:52 on dist-test-slave-68xk"
server_key: "18fb2cf1837d5b491dd9e54a2e56f3e9"
server_key_iv: "7390e3b003bc7e3a63286c9253439d40"
server_key_version: "encryptionkey@0"
I20260809 02:29:52.901839 18118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "5e31e21548f0430da627eaac79dfccc7"
format_stamp: "Formatted at 2026-08-09 02:29:52 on dist-test-slave-68xk"
server_key: "18fb2cf1837d5b491dd9e54a2e56f3e9"
server_key_iv: "7390e3b003bc7e3a63286c9253439d40"
server_key_version: "encryptionkey@0"
I20260809 02:29:52.905865 18118 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 02:29:52.908694 18142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:52.910043 18118 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:29:52.910161 18118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "5e31e21548f0430da627eaac79dfccc7"
format_stamp: "Formatted at 2026-08-09 02:29:52 on dist-test-slave-68xk"
server_key: "18fb2cf1837d5b491dd9e54a2e56f3e9"
server_key_iv: "7390e3b003bc7e3a63286c9253439d40"
server_key_version: "encryptionkey@0"
I20260809 02:29:52.910254 18118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:52.933477 18118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:52.937187 18118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:52.937417 18118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:52.938051 18118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:52.939029 18118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:52.939108 18118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:52.939172 18118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:52.939200 18118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:52.948055 18118 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:46207
I20260809 02:29:52.948169 18309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:46207 every 8 connection(s)
I20260809 02:29:52.949016 18118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:29:52.949532 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 18118
I20260809 02:29:52.949676 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:29:52.950047 22362 external_mini_cluster.cc:1428] Setting key 32d106dba957716337f3cf60047cd9c3
WARNING: no policy specified for kudu/127.21.214.130@KRBTEST.COM; defaulting to no policy
Aug 09 02:29:52 dist-test-slave-68xk krb5kdc[17962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242592, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.129@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.130@KRBTEST.COM" created.
I20260809 02:29:52.967461 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:52.951533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:52759 (local address 127.21.214.190:40277)
0809 02:29:52.951715 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:52.951721 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:52.952725 (+ 1004us) server_negotiation.cc:407] Connection header received
0809 02:29:52.954848 (+ 2123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:52.954851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:52.954904 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:52.954990 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:52.956555 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:52.957544 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:52.959021 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:52.959427 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:52.959564 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:52.962756 (+ 3192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:52.962763 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:52.962769 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:52.962804 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:52.964680 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:52.965418 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:52.965422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:52.965424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:52.965533 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:52.965927 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:52.965933 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:52.965937 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:52.966234 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:52.966349 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:52.966995 (+ 646us) server_negotiation.cc:299] Negotiation successful
0809 02:29:52.967215 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 02:29:52.968505 18314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:52.951986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40277 (local address 127.21.214.129:52759)
0809 02:29:52.952536 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:52.952596 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:52.954511 (+ 1915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:52.955288 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:52.955302 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:52.955805 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:52.956364 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:52.956380 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:52.957713 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:52.957716 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:52.958874 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:52.958886 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:52.959615 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:52.959618 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:52.959784 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:52.960470 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:52.960512 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:52.962475 (+ 1963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:52.964808 (+ 2333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:52.964818 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:52.964840 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:52.965262 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:52.965644 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:52.965646 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:52.965647 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:52.965813 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:52.966351 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:52.966357 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:52.966716 (+ 359us) client_negotiation.cc:769] Sending connection context
0809 02:29:52.966888 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 02:29:52.967257 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":166,"threads_started":1}
I20260809 02:29:52.970029 18311 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40277
I20260809 02:29:52.970350 18311 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:52.970999 18311 heartbeater.cc:511] Master 127.21.214.190:40277 requested a full tablet report, sending...
I20260809 02:29:52.972827 18028 ts_manager.cc:194] Registered new tserver with Master: 5e31e21548f0430da627eaac79dfccc7 (127.21.214.129:46207)
I20260809 02:29:52.974592 18028 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.129@KRBTEST.COM'} at 127.21.214.129:52759
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
Entry for principal kudu/127.21.214.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab.
I20260809 02:29:52.986078 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40277
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:44111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:53.107455 18317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:53.107757 18317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:53.107846 18317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:53.111922 18317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:53.112006 18317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:53.112159 18317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:29:53.117751 18317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:44111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.130.keytab
--principal=kudu/127.21.214.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:53.118844 18317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:53.119875 18317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:53.130020 18323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:53.129993 18327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:53.129973 18325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:53.130503 18317 server_base.cc:1034] running on GCE node
I20260809 02:29:53.130982 18317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:53.131711 18317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:53.132936 18317 hybrid_clock.cc:648] HybridClock initialized: now 1786242593132910 us; error 39 us; skew 500 ppm
Aug 09 02:29:53 dist-test-slave-68xk krb5kdc[17962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242593, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:53.136257 18317 init.cc:377] Logged in from keytab as kudu/127.21.214.130@KRBTEST.COM (short username kudu)
I20260809 02:29:53.137270 18317 webserver.cc:460] Webserver started at http://127.21.214.130:44241/ using document root <none> and password file <none>
I20260809 02:29:53.137908 18317 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:53.138011 18317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:53.138273 18317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:53.140569 18317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "3e7a27c29a554208ac69d80d0cc71824"
format_stamp: "Formatted at 2026-08-09 02:29:53 on dist-test-slave-68xk"
server_key: "d144bcc97c3b9c4c6957a37f25fe03ab"
server_key_iv: "73eed52137a2bab0e719ccaf58edd117"
server_key_version: "encryptionkey@0"
I20260809 02:29:53.141212 18317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "3e7a27c29a554208ac69d80d0cc71824"
format_stamp: "Formatted at 2026-08-09 02:29:53 on dist-test-slave-68xk"
server_key: "d144bcc97c3b9c4c6957a37f25fe03ab"
server_key_iv: "73eed52137a2bab0e719ccaf58edd117"
server_key_version: "encryptionkey@0"
I20260809 02:29:53.145347 18317 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 02:29:53.147899 18337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:53.149212 18317 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:29:53.149380 18317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "3e7a27c29a554208ac69d80d0cc71824"
format_stamp: "Formatted at 2026-08-09 02:29:53 on dist-test-slave-68xk"
server_key: "d144bcc97c3b9c4c6957a37f25fe03ab"
server_key_iv: "73eed52137a2bab0e719ccaf58edd117"
server_key_version: "encryptionkey@0"
I20260809 02:29:53.149506 18317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:53.168537 18317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:53.172041 18317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:53.172266 18317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:53.172926 18317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:53.173799 18317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:53.173870 18317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:53.173943 18317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:53.173993 18317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:53.183104 18317 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:43593
I20260809 02:29:53.183140 18482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:43593 every 8 connection(s)
I20260809 02:29:53.184021 18317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:29:53.194340 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 18317
I20260809 02:29:53.194536 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
Aug 09 02:29:53 dist-test-slave-68xk krb5kdc[17962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242593, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.130@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:29:53.194921 22362 external_mini_cluster.cc:1428] Setting key fb6e96e35611b666437d89550fd42981
I20260809 02:29:53.199865 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.186110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:39381 (local address 127.21.214.190:40277)
0809 02:29:53.186273 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:53.186278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:53.187324 (+ 1046us) server_negotiation.cc:407] Connection header received
0809 02:29:53.188769 (+ 1445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:53.188772 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:53.188824 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:53.188914 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:53.190178 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.190861 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.192131 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.192374 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.192467 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.195487 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:53.195493 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:53.195500 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:53.195551 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:53.197151 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:53.197819 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:53.197822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:53.197823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:53.197905 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:53.198404 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:53.198407 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:53.198468 (+ 61us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:53.198692 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:53.198789 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:53.199450 (+ 661us) server_negotiation.cc:299] Negotiation successful
0809 02:29:53.199621 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 02:29:53.200590 18486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.186659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40277 (local address 127.21.214.130:39381)
0809 02:29:53.187130 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:53.187207 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:53.188534 (+ 1327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:53.189094 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:53.189101 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:53.189500 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:53.190022 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.190036 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.190996 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.190999 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.191999 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.192009 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.192525 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.192528 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.192685 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.193384 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:53.193403 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:53.195291 (+ 1888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:53.197290 (+ 1999us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:53.197300 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:53.197318 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:53.197709 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:53.198001 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:53.198007 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:53.198012 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:53.198211 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:53.198816 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:53.198826 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:53.199178 (+ 352us) client_negotiation.cc:769] Sending connection context
0809 02:29:53.199354 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 02:29:53.199625 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":107,"threads_started":1}
I20260809 02:29:53.201790 18483 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40277
I20260809 02:29:53.202059 18483 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:53.202638 18483 heartbeater.cc:511] Master 127.21.214.190:40277 requested a full tablet report, sending...
I20260809 02:29:53.203795 18028 ts_manager.cc:194] Registered new tserver with Master: 3e7a27c29a554208ac69d80d0cc71824 (127.21.214.130:43593)
I20260809 02:29:53.204387 18028 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.130@KRBTEST.COM'} at 127.21.214.130:39381
WARNING: no policy specified for kudu/127.21.214.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
Entry for principal kudu/127.21.214.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab.
I20260809 02:29:53.230221 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40277
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:44111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:53.352924 18489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:53.353184 18489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:53.353255 18489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:53.357431 18489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:53.357489 18489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:53.357573 18489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:29:53.363204 18489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:44111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.131.keytab
--principal=kudu/127.21.214.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:40277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:53.364245 18489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:53.365301 18489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:53.375113 18499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:53.375102 18503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:53.375279 18489 server_base.cc:1034] running on GCE node
W20260809 02:29:53.375105 18500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:53.375784 18489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:53.376421 18489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:53.377627 18489 hybrid_clock.cc:648] HybridClock initialized: now 1786242593377607 us; error 30 us; skew 500 ppm
Aug 09 02:29:53 dist-test-slave-68xk krb5kdc[17962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242593, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:53.380610 18489 init.cc:377] Logged in from keytab as kudu/127.21.214.131@KRBTEST.COM (short username kudu)
I20260809 02:29:53.381498 18489 webserver.cc:460] Webserver started at http://127.21.214.131:37571/ using document root <none> and password file <none>
I20260809 02:29:53.382115 18489 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:53.382211 18489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:53.382557 18489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:53.384716 18489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "2aab7c0ee77744a9b3ff76a896a174f9"
format_stamp: "Formatted at 2026-08-09 02:29:53 on dist-test-slave-68xk"
server_key: "21204969b598590b10019ab95b08d116"
server_key_iv: "a31b1fa196bf1d7f2d8138e3f636d200"
server_key_version: "encryptionkey@0"
I20260809 02:29:53.385337 18489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "2aab7c0ee77744a9b3ff76a896a174f9"
format_stamp: "Formatted at 2026-08-09 02:29:53 on dist-test-slave-68xk"
server_key: "21204969b598590b10019ab95b08d116"
server_key_iv: "a31b1fa196bf1d7f2d8138e3f636d200"
server_key_version: "encryptionkey@0"
I20260809 02:29:53.389284 18489 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 02:29:53.391858 18513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:53.393127 18489 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:29:53.393294 18489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "2aab7c0ee77744a9b3ff76a896a174f9"
format_stamp: "Formatted at 2026-08-09 02:29:53 on dist-test-slave-68xk"
server_key: "21204969b598590b10019ab95b08d116"
server_key_iv: "a31b1fa196bf1d7f2d8138e3f636d200"
server_key_version: "encryptionkey@0"
I20260809 02:29:53.393409 18489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:53.407568 18489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:53.411075 18489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:53.411301 18489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:53.411929 18489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:53.412972 18489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:53.413044 18489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:53.413120 18489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:53.413169 18489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:53.422886 18489 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:46481
I20260809 02:29:53.422925 18663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:46481 every 8 connection(s)
I20260809 02:29:53.423821 18489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:29:53.428522 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 18489
I20260809 02:29:53.428676 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:29:53.429023 22362 external_mini_cluster.cc:1428] Setting key 0b0a63439fb273213a2bb0937122fb3c
Aug 09 02:29:53 dist-test-slave-68xk krb5kdc[17962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242593, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.131@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:29:53.438545 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.425822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:55167 (local address 127.21.214.190:40277)
0809 02:29:53.425970 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:53.425973 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:53.426852 (+ 879us) server_negotiation.cc:407] Connection header received
0809 02:29:53.428182 (+ 1330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:53.428184 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:53.428233 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:53.428310 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:53.429888 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.430652 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.431973 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.432182 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.432275 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.434711 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:53.434714 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:53.434716 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:53.434784 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:53.436318 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:53.436933 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:53.436936 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:53.436938 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:53.437024 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:53.437388 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:53.437391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:53.437392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:53.437577 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:53.437667 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:53.438212 (+ 545us) server_negotiation.cc:299] Negotiation successful
0809 02:29:53.438331 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:29:53.439458 18668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.426191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:40277 (local address 127.21.214.131:55167)
0809 02:29:53.426692 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:53.426736 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:53.427978 (+ 1242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:53.428520 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:53.428530 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:53.429058 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:53.429728 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.429755 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.430780 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.430783 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.431856 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.431866 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.432317 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.432320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.432464 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.433024 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:29:53.433041 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:53.434566 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:53.436452 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:53.436457 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:53.436470 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:53.436789 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:53.437135 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:29:53.437138 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:29:53.437140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:29:53.437294 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:29:53.437685 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:53.437691 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:53.437936 (+ 245us) client_negotiation.cc:769] Sending connection context
0809 02:29:53.438111 (+ 175us) client_negotiation.cc:240] Negotiation successful
0809 02:29:53.438384 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":178,"threads_started":1}
I20260809 02:29:53.440847 18665 heartbeater.cc:347] Connected to a master server at 127.21.214.190:40277
I20260809 02:29:53.441141 18665 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:53.441800 18665 heartbeater.cc:511] Master 127.21.214.190:40277 requested a full tablet report, sending...
I20260809 02:29:53.443059 18028 ts_manager.cc:194] Registered new tserver with Master: 2aab7c0ee77744a9b3ff76a896a174f9 (127.21.214.131:46481)
I20260809 02:29:53.443660 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:29:53.443876 18028 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.21.214.131@KRBTEST.COM'} at 127.21.214.131:55167
I20260809 02:29:53.454568 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.446115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44962 (local address 127.21.214.190:40277)
0809 02:29:53.446280 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:53.446285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:53.446495 (+ 210us) server_negotiation.cc:407] Connection header received
0809 02:29:53.446675 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:53.446677 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:53.446718 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:53.446792 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:53.447510 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.448013 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.448979 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.449222 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.449319 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.450975 (+ 1656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:53.450979 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:53.450981 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:53.451005 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:53.452680 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:53.453118 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:53.453121 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:53.453122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:53.453216 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:53.453482 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:53.453485 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:53.453486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:53.453821 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:53.453941 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:53.454223 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 02:29:53.454331 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 02:29:53.457751 18028 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44962:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:29:53.460970 18028 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:29:53.476467 18690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.471322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34390 (local address 127.21.214.130:43593)
0809 02:29:53.471737 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:53.471751 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:53.471817 (+ 66us) server_negotiation.cc:407] Connection header received
0809 02:29:53.471959 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:53.471965 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:53.472165 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:53.472324 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:53.472559 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.473808 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.475204 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.475781 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.475927 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.476075 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:53.476213 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 02:29:53.476321 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":132,"threads_started":1}
I20260809 02:29:53.476459 18689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.471005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:43593 (local address 127.0.0.1:34390)
0809 02:29:53.471739 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:53.471752 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:53.471853 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:53.472305 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:53.472308 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:53.472326 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:53.472426 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.472432 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.473978 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.473984 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.475089 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.475096 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.475913 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.475917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.476019 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.476057 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 02:29:53.476175 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 02:29:53.476299 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"spinlock_wait_cycles":768,"thread_start_us":91,"threads_started":1}
I20260809 02:29:53.476680 18679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.470075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:46481 (local address 127.0.0.1:37714)
0809 02:29:53.470633 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:53.470690 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:53.470820 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:53.471808 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:53.471814 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:53.471856 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:53.471988 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.471995 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.473545 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.473548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.474905 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.474916 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.476146 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.476150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.476334 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.476382 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 02:29:53.476451 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 02:29:53.476528 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":88,"spinlock_wait_cycles":11904,"thread_start_us":83,"threads_started":1}
I20260809 02:29:53.476788 18684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.470371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32904 (local address 127.21.214.129:46207)
0809 02:29:53.470836 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:53.470843 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:53.471530 (+ 687us) server_negotiation.cc:407] Connection header received
0809 02:29:53.471705 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:53.471711 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:53.471929 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:53.472033 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:53.472509 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.473236 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.474930 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.475826 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.475953 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.476076 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:53.476519 (+ 443us) server_negotiation.cc:299] Negotiation successful
0809 02:29:53.476615 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":140,"threads_started":1}
I20260809 02:29:53.477114 18682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.470205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37714 (local address 127.21.214.131:46481)
0809 02:29:53.471079 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:53.471091 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:53.471116 (+ 25us) server_negotiation.cc:407] Connection header received
0809 02:29:53.471202 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:53.471207 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:53.471420 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:53.471609 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:53.472138 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.473384 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.475039 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.475839 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.475953 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.476076 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:53.476860 (+ 784us) server_negotiation.cc:299] Negotiation successful
0809 02:29:53.476965 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":763,"thread_start_us":111,"threads_started":1}
I20260809 02:29:53.477281 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.470075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:46207 (local address 127.0.0.1:32904)
0809 02:29:53.471401 (+ 1326us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:53.471418 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:53.471529 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:53.472237 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:53.472240 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:53.472259 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:53.472353 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.472358 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.473368 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.473373 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.474804 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.474814 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.476155 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.476159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.476308 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.476374 (+ 66us) client_negotiation.cc:769] Sending connection context
0809 02:29:53.477036 (+ 662us) client_negotiation.cc:240] Negotiation successful
0809 02:29:53.477106 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1253,"mutex_wait_us":810,"thread_start_us":94,"threads_started":1}
I20260809 02:29:53.479861 18397 tablet_service.cc:1467] Processing CreateTablet for tablet 61cbc767fb0a424aab8896d3b833ce9d (DEFAULT_TABLE table=test-table [id=54052cefab8b416cbb92025737041483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:53.479991 18576 tablet_service.cc:1467] Processing CreateTablet for tablet 61cbc767fb0a424aab8896d3b833ce9d (DEFAULT_TABLE table=test-table [id=54052cefab8b416cbb92025737041483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:53.480530 18220 tablet_service.cc:1467] Processing CreateTablet for tablet 61cbc767fb0a424aab8896d3b833ce9d (DEFAULT_TABLE table=test-table [id=54052cefab8b416cbb92025737041483]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:53.481027 18397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61cbc767fb0a424aab8896d3b833ce9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:53.481087 18576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61cbc767fb0a424aab8896d3b833ce9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:53.481448 18220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61cbc767fb0a424aab8896d3b833ce9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:53.487651 18692 tablet_bootstrap.cc:492] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824: Bootstrap starting.
I20260809 02:29:53.489132 18694 tablet_bootstrap.cc:492] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7: Bootstrap starting.
I20260809 02:29:53.490144 18692 tablet_bootstrap.cc:654] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:53.490733 18695 tablet_bootstrap.cc:492] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9: Bootstrap starting.
I20260809 02:29:53.491488 18694 tablet_bootstrap.cc:654] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:53.491822 18692 log.cc:824] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:53.492455 18694 log.cc:824] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:53.492944 18695 tablet_bootstrap.cc:654] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:53.494061 18695 log.cc:824] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:53.494103 18692 tablet_bootstrap.cc:492] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824: No bootstrap required, opened a new log
I20260809 02:29:53.494313 18692 ts_tablet_manager.cc:1397] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 02:29:53.494609 18694 tablet_bootstrap.cc:492] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7: No bootstrap required, opened a new log
I20260809 02:29:53.494874 18694 ts_tablet_manager.cc:1397] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:29:53.495814 18695 tablet_bootstrap.cc:492] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9: No bootstrap required, opened a new log
I20260809 02:29:53.496017 18695 ts_tablet_manager.cc:1397] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260809 02:29:53.498633 18692 raft_consensus.cc:348] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aab7c0ee77744a9b3ff76a896a174f9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46481 } } peers { permanent_uuid: "5e31e21548f0430da627eaac79dfccc7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46207 } } peers { permanent_uuid: "3e7a27c29a554208ac69d80d0cc71824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 43593 } }
I20260809 02:29:53.499080 18692 raft_consensus.cc:374] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:53.499185 18692 raft_consensus.cc:729] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e7a27c29a554208ac69d80d0cc71824, State: Initialized, Role: FOLLOWER
I20260809 02:29:53.499363 18694 raft_consensus.cc:348] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aab7c0ee77744a9b3ff76a896a174f9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46481 } } peers { permanent_uuid: "5e31e21548f0430da627eaac79dfccc7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46207 } } peers { permanent_uuid: "3e7a27c29a554208ac69d80d0cc71824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 43593 } }
I20260809 02:29:53.499426 18695 raft_consensus.cc:348] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aab7c0ee77744a9b3ff76a896a174f9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46481 } } peers { permanent_uuid: "5e31e21548f0430da627eaac79dfccc7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46207 } } peers { permanent_uuid: "3e7a27c29a554208ac69d80d0cc71824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 43593 } }
I20260809 02:29:53.499661 18694 raft_consensus.cc:374] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:53.499711 18694 raft_consensus.cc:729] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e31e21548f0430da627eaac79dfccc7, State: Initialized, Role: FOLLOWER
I20260809 02:29:53.499744 18695 raft_consensus.cc:374] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:53.499815 18695 raft_consensus.cc:729] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aab7c0ee77744a9b3ff76a896a174f9, State: Initialized, Role: FOLLOWER
I20260809 02:29:53.499758 18692 consensus_queue.cc:260] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aab7c0ee77744a9b3ff76a896a174f9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46481 } } peers { permanent_uuid: "5e31e21548f0430da627eaac79dfccc7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46207 } } peers { permanent_uuid: "3e7a27c29a554208ac69d80d0cc71824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 43593 } }
I20260809 02:29:53.500241 18695 consensus_queue.cc:260] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aab7c0ee77744a9b3ff76a896a174f9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46481 } } peers { permanent_uuid: "5e31e21548f0430da627eaac79dfccc7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46207 } } peers { permanent_uuid: "3e7a27c29a554208ac69d80d0cc71824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 43593 } }
I20260809 02:29:53.500196 18694 consensus_queue.cc:260] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aab7c0ee77744a9b3ff76a896a174f9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46481 } } peers { permanent_uuid: "5e31e21548f0430da627eaac79dfccc7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46207 } } peers { permanent_uuid: "3e7a27c29a554208ac69d80d0cc71824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 43593 } }
I20260809 02:29:53.500851 18692 ts_tablet_manager.cc:1428] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260809 02:29:53.500890 18665 heartbeater.cc:503] Master 127.21.214.190:40277 was elected leader, sending a full tablet report...
I20260809 02:29:53.501169 18695 ts_tablet_manager.cc:1428] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260809 02:29:53.501279 18483 heartbeater.cc:503] Master 127.21.214.190:40277 was elected leader, sending a full tablet report...
I20260809 02:29:53.501696 18694 ts_tablet_manager.cc:1428] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 02:29:53.501796 18311 heartbeater.cc:503] Master 127.21.214.190:40277 was elected leader, sending a full tablet report...
I20260809 02:29:53.554070 18700 raft_consensus.cc:482] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:29:53.554343 18700 raft_consensus.cc:504] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aab7c0ee77744a9b3ff76a896a174f9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46481 } } peers { permanent_uuid: "5e31e21548f0430da627eaac79dfccc7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46207 } } peers { permanent_uuid: "3e7a27c29a554208ac69d80d0cc71824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 43593 } }
I20260809 02:29:53.555585 18700 leader_election.cc:288] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2aab7c0ee77744a9b3ff76a896a174f9 (127.21.214.131:46481), 5e31e21548f0430da627eaac79dfccc7 (127.21.214.129:46207)
I20260809 02:29:53.560667 18684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.556086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:38435 (local address 127.21.214.129:46207)
0809 02:29:53.556254 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:53.556260 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:53.556516 (+ 256us) server_negotiation.cc:407] Connection header received
0809 02:29:53.556593 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:53.556596 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:53.556643 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:53.556753 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:53.557101 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.557864 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.559397 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.560045 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.560186 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.560251 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:53.560455 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 02:29:53.560532 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 02:29:53.560667 18682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.555991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:35351 (local address 127.21.214.131:46481)
0809 02:29:53.556147 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:53.556151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:53.556169 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:29:53.556230 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:53.556236 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:53.556300 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:53.556376 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:53.556730 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.557616 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.559293 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.559956 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.560099 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.560160 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:53.560455 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 02:29:53.560532 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 02:29:53.560699 18486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.555783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:46481 (local address 127.21.214.130:35351)
0809 02:29:53.555896 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:53.555915 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:53.556012 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:53.556426 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:53.556432 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:53.556460 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:53.556599 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.556608 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.557737 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.557739 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.559132 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.559143 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.560084 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.560110 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.560250 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.560338 (+ 88us) client_negotiation.cc:769] Sending connection context
0809 02:29:53.560420 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 02:29:53.560533 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24,"mutex_wait_us":42}
I20260809 02:29:53.560710 18703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.555937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:46207 (local address 127.21.214.130:38435)
0809 02:29:53.556374 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:53.556391 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:53.556514 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:53.556786 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:53.556788 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:53.556804 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:53.556902 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.556906 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.558076 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.558079 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.559264 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:53.559273 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.560148 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.560151 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:53.560235 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.560337 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 02:29:53.560420 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 02:29:53.560537 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":73,"spinlock_wait_cycles":1408,"thread_start_us":149,"threads_started":1}
I20260809 02:29:53.561440 18247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61cbc767fb0a424aab8896d3b833ce9d" candidate_uuid: "3e7a27c29a554208ac69d80d0cc71824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e31e21548f0430da627eaac79dfccc7" is_pre_election: true
I20260809 02:29:53.561648 18604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61cbc767fb0a424aab8896d3b833ce9d" candidate_uuid: "3e7a27c29a554208ac69d80d0cc71824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aab7c0ee77744a9b3ff76a896a174f9" is_pre_election: true
I20260809 02:29:53.561761 18247 raft_consensus.cc:2454] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e7a27c29a554208ac69d80d0cc71824 in term 0.
I20260809 02:29:53.561966 18604 raft_consensus.cc:2454] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e7a27c29a554208ac69d80d0cc71824 in term 0.
I20260809 02:29:53.562351 18338 leader_election.cc:302] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e7a27c29a554208ac69d80d0cc71824, 5e31e21548f0430da627eaac79dfccc7; no voters:
I20260809 02:29:53.562729 18700 raft_consensus.cc:2781] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:29:53.562816 18700 raft_consensus.cc:482] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:29:53.562860 18700 raft_consensus.cc:3037] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:53.564064 18700 raft_consensus.cc:504] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aab7c0ee77744a9b3ff76a896a174f9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46481 } } peers { permanent_uuid: "5e31e21548f0430da627eaac79dfccc7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46207 } } peers { permanent_uuid: "3e7a27c29a554208ac69d80d0cc71824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 43593 } }
I20260809 02:29:53.564402 18700 leader_election.cc:288] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [CANDIDATE]: Term 1 election: Requested vote from peers 2aab7c0ee77744a9b3ff76a896a174f9 (127.21.214.131:46481), 5e31e21548f0430da627eaac79dfccc7 (127.21.214.129:46207)
I20260809 02:29:53.564749 18604 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61cbc767fb0a424aab8896d3b833ce9d" candidate_uuid: "3e7a27c29a554208ac69d80d0cc71824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aab7c0ee77744a9b3ff76a896a174f9"
I20260809 02:29:53.564749 18247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61cbc767fb0a424aab8896d3b833ce9d" candidate_uuid: "3e7a27c29a554208ac69d80d0cc71824" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e31e21548f0430da627eaac79dfccc7"
I20260809 02:29:53.564886 18604 raft_consensus.cc:3037] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:53.564886 18247 raft_consensus.cc:3037] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:53.566083 18604 raft_consensus.cc:2454] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e7a27c29a554208ac69d80d0cc71824 in term 1.
I20260809 02:29:53.566141 18247 raft_consensus.cc:2454] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e7a27c29a554208ac69d80d0cc71824 in term 1.
I20260809 02:29:53.566457 18340 leader_election.cc:302] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aab7c0ee77744a9b3ff76a896a174f9, 3e7a27c29a554208ac69d80d0cc71824; no voters:
I20260809 02:29:53.566656 18700 raft_consensus.cc:2781] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:53.566891 18700 raft_consensus.cc:686] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [term 1 LEADER]: Becoming Leader. State: Replica: 3e7a27c29a554208ac69d80d0cc71824, State: Running, Role: LEADER
I20260809 02:29:53.567230 18700 consensus_queue.cc:237] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aab7c0ee77744a9b3ff76a896a174f9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46481 } } peers { permanent_uuid: "5e31e21548f0430da627eaac79dfccc7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46207 } } peers { permanent_uuid: "3e7a27c29a554208ac69d80d0cc71824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 43593 } }
I20260809 02:29:53.570683 18028 catalog_manager.cc:5495] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e7a27c29a554208ac69d80d0cc71824 (127.21.214.130). New cstate: current_term: 1 leader_uuid: "3e7a27c29a554208ac69d80d0cc71824" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aab7c0ee77744a9b3ff76a896a174f9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e31e21548f0430da627eaac79dfccc7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e7a27c29a554208ac69d80d0cc71824" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 43593 } health_report { overall_health: HEALTHY } } }
I20260809 02:29:53.598078 18690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.594254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34392 (local address 127.21.214.130:43593)
0809 02:29:53.594434 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:53.594440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:53.594455 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:29:53.594631 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:53.594634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:53.594697 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:53.594829 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:29:53.595101 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.595621 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.596510 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.596765 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.596881 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.597226 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:29:53.597648 (+ 422us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:29:53.597803 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:53.597842 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 02:29:53.597900 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:29:53.604274 18604 raft_consensus.cc:1261] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9 [term 1 FOLLOWER]: Refusing update from remote peer 3e7a27c29a554208ac69d80d0cc71824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:53.604292 18247 raft_consensus.cc:1261] T 61cbc767fb0a424aab8896d3b833ce9d P 5e31e21548f0430da627eaac79dfccc7 [term 1 FOLLOWER]: Refusing update from remote peer 3e7a27c29a554208ac69d80d0cc71824: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:53.605026 18700 consensus_queue.cc:1035] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e31e21548f0430da627eaac79dfccc7" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 46207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:53.605293 18705 consensus_queue.cc:1035] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aab7c0ee77744a9b3ff76a896a174f9" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 46481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:53.613859 18710 mvcc.cc:205] Tried to move back new op lower bound from 7316449663395004416 to 7316449663254269952. Current Snapshot: MvccSnapshot[applied={T|T < 7316449663395004416}]
I20260809 02:29:53.614521 18708 mvcc.cc:205] Tried to move back new op lower bound from 7316449663395004416 to 7316449663254269952. Current Snapshot: MvccSnapshot[applied={T|T < 7316449663395004416}]
I20260809 02:29:53.623239 18031 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:53.623436 18031 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:53.626027 18031 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44130c140f1644ad828db0783e4db14b: Sending DeleteTablet for 3 replicas of tablet 61cbc767fb0a424aab8896d3b833ce9d
I20260809 02:29:53.626936 18576 tablet_service.cc:1514] Processing DeleteTablet for tablet 61cbc767fb0a424aab8896d3b833ce9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:53 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:37714
I20260809 02:29:53.626986 18220 tablet_service.cc:1514] Processing DeleteTablet for tablet 61cbc767fb0a424aab8896d3b833ce9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:53 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:32904
I20260809 02:29:53.626992 18397 tablet_service.cc:1514] Processing DeleteTablet for tablet 61cbc767fb0a424aab8896d3b833ce9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:53 UTC) from {username='kudu', principal='kudu/127.21.214.190@KRBTEST.COM'} at 127.0.0.1:34390
I20260809 02:29:53.627454 18722 tablet_replica.cc:330] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824: stopping tablet replica
I20260809 02:29:53.627776 18719 tablet_replica.cc:330] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9: stopping tablet replica
I20260809 02:29:53.627815 18722 raft_consensus.cc:2229] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [term 1 LEADER]: Raft consensus shutting down.
I20260809 02:29:53.628129 18719 raft_consensus.cc:2229] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:29:53.628301 18722 raft_consensus.cc:2258] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:53.628327 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 18118
I20260809 02:29:53.630973 18719 raft_consensus.cc:2258] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:53.632898 18719 ts_tablet_manager.cc:1905] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:53.635442 18722 ts_tablet_manager.cc:1905] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:53.638180 18722 ts_tablet_manager.cc:1918] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:53.638286 18722 log.cc:1196] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/61cbc767fb0a424aab8896d3b833ce9d
I20260809 02:29:53.638680 18722 ts_tablet_manager.cc:1939] T 61cbc767fb0a424aab8896d3b833ce9d P 3e7a27c29a554208ac69d80d0cc71824: Deleting consensus metadata
I20260809 02:29:53.639932 18005 catalog_manager.cc:4841] TS 3e7a27c29a554208ac69d80d0cc71824 (127.21.214.130:43593): tablet 61cbc767fb0a424aab8896d3b833ce9d (table test-table [id=54052cefab8b416cbb92025737041483]) successfully deleted
I20260809 02:29:53.643893 18719 ts_tablet_manager.cc:1918] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:53.644078 18719 log.cc:1196] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/61cbc767fb0a424aab8896d3b833ce9d
I20260809 02:29:53.644485 18719 ts_tablet_manager.cc:1939] T 61cbc767fb0a424aab8896d3b833ce9d P 2aab7c0ee77744a9b3ff76a896a174f9: Deleting consensus metadata
I20260809 02:29:53.645901 18006 catalog_manager.cc:4841] TS 2aab7c0ee77744a9b3ff76a896a174f9 (127.21.214.131:46481): tablet 61cbc767fb0a424aab8896d3b833ce9d (table test-table [id=54052cefab8b416cbb92025737041483]) successfully deleted
W20260809 02:29:53.649880 18005 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:46207 (error 108)
I20260809 02:29:53.650888 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 18317
I20260809 02:29:53.653317 18687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.650811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:46207 (local address 127.0.0.1:32908)
0809 02:29:53.653132 (+ 2321us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:53.653212 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:46207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2210}
W20260809 02:29:53.654428 18005 catalog_manager.cc:4584] TS 5e31e21548f0430da627eaac79dfccc7 (127.21.214.129:46207): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 61cbc767fb0a424aab8896d3b833ce9d: Network error: Client connection negotiation failed: client connection to 127.21.214.129:46207: connect: Connection refused (error 111)
I20260809 02:29:53.664196 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 18489
I20260809 02:29:53.673743 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 17984
2026-08-09T02:29:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2586 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T02:29:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:29:53Z Disabled control of system clock
I20260809 02:29:53.710937 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:33647
--webserver_interface=127.21.214.190
--webserver_port=0
--builtin_ntp_servers=127.21.214.148:36587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:33647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:29:53.822535 18728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:53.822774 18728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:53.822809 18728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:53.826771 18728 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:29:53.826821 18728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:53.826838 18728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:53.826854 18728 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:29:53.826869 18728 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:29:53.831468 18728 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:36587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:33647
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:33647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:53.832417 18728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:53.833699 18728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:53.842382 18737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:53.842429 18738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:53.842444 18744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:53.842832 18728 server_base.cc:1034] running on GCE node
I20260809 02:29:53.843484 18728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:53.844515 18728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:53.845712 18728 hybrid_clock.cc:648] HybridClock initialized: now 1786242593845679 us; error 43 us; skew 500 ppm
I20260809 02:29:53.847784 18728 webserver.cc:460] Webserver started at http://127.21.214.190:34183/ using document root <none> and password file <none>
I20260809 02:29:53.848444 18728 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:53.848515 18728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:53.848744 18728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:53.850900 18728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "5536389bde7840bb87e602bd2de77b38"
format_stamp: "Formatted at 2026-08-09 02:29:53 on dist-test-slave-68xk"
server_key: "0fbf9355b37397278c9469d5087a49b3"
server_key_iv: "991bc4f7e353fdf2e5324490afb09ec7"
server_key_version: "encryptionkey@0"
I20260809 02:29:53.851485 18728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "5536389bde7840bb87e602bd2de77b38"
format_stamp: "Formatted at 2026-08-09 02:29:53 on dist-test-slave-68xk"
server_key: "0fbf9355b37397278c9469d5087a49b3"
server_key_iv: "991bc4f7e353fdf2e5324490afb09ec7"
server_key_version: "encryptionkey@0"
I20260809 02:29:53.855295 18728 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 02:29:53.857950 18752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:53.859252 18728 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:29:53.859403 18728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "5536389bde7840bb87e602bd2de77b38"
format_stamp: "Formatted at 2026-08-09 02:29:53 on dist-test-slave-68xk"
server_key: "0fbf9355b37397278c9469d5087a49b3"
server_key_iv: "991bc4f7e353fdf2e5324490afb09ec7"
server_key_version: "encryptionkey@0"
I20260809 02:29:53.859520 18728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:53.881373 18728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:53.882117 18728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:53.882337 18728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:53.889756 18728 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:33647
I20260809 02:29:53.889775 18825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:33647 every 8 connection(s)
I20260809 02:29:53.890753 18728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:29:53.893911 18826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:53.897179 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 18728
I20260809 02:29:53.897372 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:29:53.897710 22362 external_mini_cluster.cc:1428] Setting key 2595b97f9959bd0da6be43ff22506399
I20260809 02:29:53.900241 18826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38: Bootstrap starting.
I20260809 02:29:53.902773 18826 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:53.903651 18826 log.cc:824] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:53.906034 18826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38: No bootstrap required, opened a new log
I20260809 02:29:53.907908 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:53.899361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43022 (local address 127.21.214.190:33647)
0809 02:29:53.900058 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:53.900075 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:53.900121 (+ 46us) server_negotiation.cc:407] Connection header received
0809 02:29:53.900875 (+ 754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:53.900894 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:53.901325 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:53.901622 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:53.902016 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.903234 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.904374 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:53.904929 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:53.905072 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:53.905972 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:53.905977 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:53.905990 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:53.906528 (+ 538us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:53.906589 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:53.906610 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:53.906692 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:53.906865 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 02:29:53.907201 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":166,"threads_started":1}
I20260809 02:29:53.910090 18826 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5536389bde7840bb87e602bd2de77b38" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33647 } }
I20260809 02:29:53.910401 18826 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:53.910482 18826 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5536389bde7840bb87e602bd2de77b38, State: Initialized, Role: FOLLOWER
I20260809 02:29:53.910949 18826 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5536389bde7840bb87e602bd2de77b38" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33647 } }
I20260809 02:29:53.911080 18826 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:29:53.911123 18826 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:29:53.911235 18826 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:53.912108 18826 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5536389bde7840bb87e602bd2de77b38" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33647 } }
I20260809 02:29:53.912410 18826 leader_election.cc:302] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5536389bde7840bb87e602bd2de77b38; no voters:
I20260809 02:29:53.912668 18826 leader_election.cc:288] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:29:53.912886 18832 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:53.913152 18832 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [term 1 LEADER]: Becoming Leader. State: Replica: 5536389bde7840bb87e602bd2de77b38, State: Running, Role: LEADER
I20260809 02:29:53.913492 18832 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5536389bde7840bb87e602bd2de77b38" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33647 } }
I20260809 02:29:53.914012 18826 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:29:53.915150 18837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5536389bde7840bb87e602bd2de77b38. Latest consensus state: current_term: 1 leader_uuid: "5536389bde7840bb87e602bd2de77b38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5536389bde7840bb87e602bd2de77b38" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33647 } } }
I20260809 02:29:53.915200 18836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5536389bde7840bb87e602bd2de77b38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5536389bde7840bb87e602bd2de77b38" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33647 } } }
I20260809 02:29:53.915292 18837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:53.915311 18836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38 [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:53.915695 18847 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:29:53.918749 18847 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:29:53.924121 18847 catalog_manager.cc:1347] Generated new cluster ID: 08d05cb72b7a48ed90cf47e2fb4d55f9
I20260809 02:29:53.924206 18847 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:29:53.938375 18847 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:29:53.939671 18847 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:29:53.945559 18847 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38: Generated new TSK 0
I20260809 02:29:53.946388 18847 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:29:53.951612 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.129:0
--local_ip_for_outbound_sockets=127.21.214.129
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33647
--builtin_ntp_servers=127.21.214.148:36587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 02:29:54.068341 18858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:54.068651 18858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:54.068738 18858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:54.072834 18858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:54.072911 18858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:54.073007 18858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.129
I20260809 02:29:54.077797 18858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:36587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.21.214.129
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.129
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:54.078987 18858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:54.080472 18858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:54.091109 18867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:54.091114 18864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:54.091120 18865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:54.091497 18858 server_base.cc:1034] running on GCE node
I20260809 02:29:54.091992 18858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:54.092658 18858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:54.093825 18858 hybrid_clock.cc:648] HybridClock initialized: now 1786242594093808 us; error 30 us; skew 500 ppm
I20260809 02:29:54.095764 18858 webserver.cc:460] Webserver started at http://127.21.214.129:40023/ using document root <none> and password file <none>
I20260809 02:29:54.096328 18858 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:54.096391 18858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:54.096561 18858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:54.098757 18858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/data/instance:
uuid: "6e8edcdb3d37453a847ea6dcc6b289c8"
format_stamp: "Formatted at 2026-08-09 02:29:54 on dist-test-slave-68xk"
server_key: "15e715b37cefeeaf86134b60107ce786"
server_key_iv: "251ffa94a44d4d2dc82df678bf0dfdad"
server_key_version: "encryptionkey@0"
I20260809 02:29:54.099280 18858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance:
uuid: "6e8edcdb3d37453a847ea6dcc6b289c8"
format_stamp: "Formatted at 2026-08-09 02:29:54 on dist-test-slave-68xk"
server_key: "15e715b37cefeeaf86134b60107ce786"
server_key_iv: "251ffa94a44d4d2dc82df678bf0dfdad"
server_key_version: "encryptionkey@0"
I20260809 02:29:54.102947 18858 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:29:54.105397 18876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:54.106716 18858 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:29:54.106849 18858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/wal
uuid: "6e8edcdb3d37453a847ea6dcc6b289c8"
format_stamp: "Formatted at 2026-08-09 02:29:54 on dist-test-slave-68xk"
server_key: "15e715b37cefeeaf86134b60107ce786"
server_key_iv: "251ffa94a44d4d2dc82df678bf0dfdad"
server_key_version: "encryptionkey@0"
I20260809 02:29:54.106957 18858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:54.132054 18858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:54.132799 18858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:54.133008 18858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:54.133644 18858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:54.134702 18858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:54.134775 18858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:54.134845 18858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:54.134892 18858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:54.144127 18858 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.129:37175
I20260809 02:29:54.144162 19032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.129:37175 every 8 connection(s)
I20260809 02:29:54.145052 18858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/data/info.pb
I20260809 02:29:54.149421 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 18858
I20260809 02:29:54.149574 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-0/wal/instance
I20260809 02:29:54.149892 22362 external_mini_cluster.cc:1428] Setting key 3fcd3f9956c5c485ac39614a3a56cdac
I20260809 02:29:54.151886 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.130:0
--local_ip_for_outbound_sockets=127.21.214.130
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33647
--builtin_ntp_servers=127.21.214.148:36587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:29:54.155700 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.146923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:55909 (local address 127.21.214.190:33647)
0809 02:29:54.147071 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:54.147075 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:54.148099 (+ 1024us) server_negotiation.cc:407] Connection header received
0809 02:29:54.149566 (+ 1467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:54.149569 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:54.149633 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:54.149725 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:54.150827 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.151482 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.152735 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.153069 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.153181 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.155007 (+ 1826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:54.155013 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:54.155018 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:54.155036 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:54.155065 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:54.155080 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:54.155175 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:54.155435 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 02:29:54.155512 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:29:54.156809 19036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.147277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:33647 (local address 127.21.214.129:55909)
0809 02:29:54.147935 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:54.147976 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:54.149332 (+ 1356us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:54.149899 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:54.149906 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:54.150025 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:54.150666 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.150684 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.151612 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.151618 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.152596 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.152606 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.153355 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.153359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.153589 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.154683 (+ 1094us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:29:54.154688 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:54.154746 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:29:54.154834 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:54.155199 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:54.155210 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:54.155217 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 02:29:54.155396 (+ 179us) client_negotiation.cc:240] Negotiation successful
0809 02:29:54.155711 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":115,"threads_started":1}
I20260809 02:29:54.158401 19033 heartbeater.cc:347] Connected to a master server at 127.21.214.190:33647
I20260809 02:29:54.158675 19033 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:54.159369 19033 heartbeater.cc:511] Master 127.21.214.190:33647 requested a full tablet report, sending...
I20260809 02:29:54.161187 18779 ts_manager.cc:194] Registered new tserver with Master: 6e8edcdb3d37453a847ea6dcc6b289c8 (127.21.214.129:37175)
I20260809 02:29:54.162619 18779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.214.129:55909
W20260809 02:29:54.271799 19037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:54.272042 19037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:54.272079 19037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:54.275978 19037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:54.276031 19037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:54.276083 19037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.130
I20260809 02:29:54.280792 19037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:36587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.21.214.130
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.130
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:54.281809 19037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:54.283246 19037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:54.293140 19052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:54.293206 19047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:54.293195 19048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:54.293416 19037 server_base.cc:1034] running on GCE node
I20260809 02:29:54.293901 19037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:54.294649 19037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:54.295845 19037 hybrid_clock.cc:648] HybridClock initialized: now 1786242594295827 us; error 28 us; skew 500 ppm
I20260809 02:29:54.297766 19037 webserver.cc:460] Webserver started at http://127.21.214.130:35627/ using document root <none> and password file <none>
I20260809 02:29:54.298357 19037 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:54.298509 19037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:54.298763 19037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:54.300807 19037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/data/instance:
uuid: "6041097c03c44f7da869768ed6925d06"
format_stamp: "Formatted at 2026-08-09 02:29:54 on dist-test-slave-68xk"
server_key: "e1a4df2036a049144e6a43e6734ae20e"
server_key_iv: "d7ffecc0eb11276386f926a34b07c427"
server_key_version: "encryptionkey@0"
I20260809 02:29:54.301373 19037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance:
uuid: "6041097c03c44f7da869768ed6925d06"
format_stamp: "Formatted at 2026-08-09 02:29:54 on dist-test-slave-68xk"
server_key: "e1a4df2036a049144e6a43e6734ae20e"
server_key_iv: "d7ffecc0eb11276386f926a34b07c427"
server_key_version: "encryptionkey@0"
I20260809 02:29:54.305070 19037 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260809 02:29:54.307540 19060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:54.308734 19037 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:29:54.308878 19037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/wal
uuid: "6041097c03c44f7da869768ed6925d06"
format_stamp: "Formatted at 2026-08-09 02:29:54 on dist-test-slave-68xk"
server_key: "e1a4df2036a049144e6a43e6734ae20e"
server_key_iv: "d7ffecc0eb11276386f926a34b07c427"
server_key_version: "encryptionkey@0"
I20260809 02:29:54.308991 19037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:54.329528 19037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:54.330233 19037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:54.330498 19037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:54.331102 19037 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:54.332049 19037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:54.332134 19037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:54.332209 19037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:54.332243 19037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:54.341814 19037 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.130:35259
I20260809 02:29:54.341836 19212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.130:35259 every 8 connection(s)
I20260809 02:29:54.342742 19037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/data/info.pb
I20260809 02:29:54.350741 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 19037
I20260809 02:29:54.350893 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/wal/instance
I20260809 02:29:54.351270 22362 external_mini_cluster.cc:1428] Setting key cb8ef50a1c8a633e644069cc5960c824
I20260809 02:29:54.352032 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.344629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.130:50941 (local address 127.21.214.190:33647)
0809 02:29:54.344806 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:54.344811 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:54.345868 (+ 1057us) server_negotiation.cc:407] Connection header received
0809 02:29:54.347298 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:54.347300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:54.347344 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:54.347416 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:54.348310 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.348844 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.349955 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.350168 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.350265 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.351504 (+ 1239us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:54.351512 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:54.351514 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:54.351527 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:54.351545 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:54.351553 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:54.351634 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:54.351818 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 02:29:54.351886 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 02:29:54.352870 19215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.345049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:33647 (local address 127.21.214.130:50941)
0809 02:29:54.345710 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:54.345755 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:54.347092 (+ 1337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:54.347578 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:54.347585 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:54.347685 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:54.348153 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.348166 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.348961 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.348963 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.349841 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.349851 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.350308 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.350310 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.350477 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.351175 (+ 698us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:29:54.351177 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:54.351219 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:29:54.351281 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:54.351670 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:54.351684 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:54.351688 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:29:54.351815 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 02:29:54.352086 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":104,"threads_started":1}
I20260809 02:29:54.353426 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.21.214.131:0
--local_ip_for_outbound_sockets=127.21.214.131
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33647
--builtin_ntp_servers=127.21.214.148:36587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 02:29:54.354045 19213 heartbeater.cc:347] Connected to a master server at 127.21.214.190:33647
I20260809 02:29:54.354279 19213 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:54.354830 19213 heartbeater.cc:511] Master 127.21.214.190:33647 requested a full tablet report, sending...
I20260809 02:29:54.355880 18779 ts_manager.cc:194] Registered new tserver with Master: 6041097c03c44f7da869768ed6925d06 (127.21.214.130:35259)
I20260809 02:29:54.356452 18779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.214.130:50941
W20260809 02:29:54.469775 19217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:54.470134 19217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:54.470232 19217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:54.474196 19217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:54.474284 19217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:54.474381 19217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.214.131
I20260809 02:29:54.479097 19217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:36587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.21.214.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.21.214.131
--webserver_port=0
--tserver_master_addrs=127.21.214.190:33647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.21.214.131
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:54.480226 19217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:54.481635 19217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:54.491325 19228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:54.491333 19224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:54.491344 19225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:54.491897 19217 server_base.cc:1034] running on GCE node
I20260809 02:29:54.492282 19217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:54.492892 19217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:54.494084 19217 hybrid_clock.cc:648] HybridClock initialized: now 1786242594494070 us; error 37 us; skew 500 ppm
I20260809 02:29:54.496023 19217 webserver.cc:460] Webserver started at http://127.21.214.131:37341/ using document root <none> and password file <none>
I20260809 02:29:54.496634 19217 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:54.496731 19217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:54.496966 19217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:54.499061 19217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/data/instance:
uuid: "4c8675bd838e48cca10ce328e02e0861"
format_stamp: "Formatted at 2026-08-09 02:29:54 on dist-test-slave-68xk"
server_key: "fee222af2c6131e2a0d1c01c592d6f24"
server_key_iv: "6edb3549d95578448f31be048d911850"
server_key_version: "encryptionkey@0"
I20260809 02:29:54.499634 19217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance:
uuid: "4c8675bd838e48cca10ce328e02e0861"
format_stamp: "Formatted at 2026-08-09 02:29:54 on dist-test-slave-68xk"
server_key: "fee222af2c6131e2a0d1c01c592d6f24"
server_key_iv: "6edb3549d95578448f31be048d911850"
server_key_version: "encryptionkey@0"
I20260809 02:29:54.503322 19217 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:29:54.505654 19236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:54.506843 19217 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:29:54.506990 19217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/wal
uuid: "4c8675bd838e48cca10ce328e02e0861"
format_stamp: "Formatted at 2026-08-09 02:29:54 on dist-test-slave-68xk"
server_key: "fee222af2c6131e2a0d1c01c592d6f24"
server_key_iv: "6edb3549d95578448f31be048d911850"
server_key_version: "encryptionkey@0"
I20260809 02:29:54.507102 19217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:54.525655 19217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:54.526298 19217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:54.526523 19217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:54.527088 19217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 02:29:54.527997 19217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 02:29:54.528074 19217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:54.528143 19217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 02:29:54.528196 19217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:54.537552 19217 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.131:39395
I20260809 02:29:54.537586 19395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.131:39395 every 8 connection(s)
I20260809 02:29:54.538498 19217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/data/info.pb
I20260809 02:29:54.541188 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 19217
I20260809 02:29:54.541306 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/wal/instance
I20260809 02:29:54.541627 22362 external_mini_cluster.cc:1428] Setting key d4c80885064b1bc88afbea367307450e
I20260809 02:29:54.548100 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.540362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.131:49781 (local address 127.21.214.190:33647)
0809 02:29:54.540510 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:54.540514 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:54.541738 (+ 1224us) server_negotiation.cc:407] Connection header received
0809 02:29:54.543452 (+ 1714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:54.543455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:54.543500 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:54.543564 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:54.544517 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.545056 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.546203 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.546479 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.546592 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.547687 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:54.547690 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:54.547692 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:54.547704 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:54.547725 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:54.547735 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:54.547794 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:54.547937 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 02:29:54.547987 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:29:54.548918 19401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.540726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:33647 (local address 127.21.214.131:49781)
0809 02:29:54.541563 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:54.541618 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:54.543230 (+ 1612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:54.543770 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:54.543776 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:54.543859 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:29:54.544395 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.544408 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.545175 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.545178 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.546097 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.546107 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.546678 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.546681 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.546834 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.547427 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 02:29:54.547429 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:29:54.547467 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 02:29:54.547528 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:29:54.547812 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:29:54.547819 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:29:54.547823 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 02:29:54.547918 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 02:29:54.548141 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":131,"threads_started":1}
I20260809 02:29:54.550050 19398 heartbeater.cc:347] Connected to a master server at 127.21.214.190:33647
I20260809 02:29:54.550313 19398 heartbeater.cc:464] Registering TS with master...
I20260809 02:29:54.550834 19398 heartbeater.cc:511] Master 127.21.214.190:33647 requested a full tablet report, sending...
I20260809 02:29:54.551847 18779 ts_manager.cc:194] Registered new tserver with Master: 4c8675bd838e48cca10ce328e02e0861 (127.21.214.131:39395)
I20260809 02:29:54.552403 18779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.21.214.131:49781
I20260809 02:29:54.555717 22362 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 02:29:54.561436 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.557692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43028 (local address 127.21.214.190:33647)
0809 02:29:54.557834 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:54.557838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:54.557963 (+ 125us) server_negotiation.cc:407] Connection header received
0809 02:29:54.558055 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:54.558057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:54.558092 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:54.558199 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:54.558513 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.558988 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.559841 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.560046 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.560131 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.560945 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:54.560949 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:54.560951 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:54.560962 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:54.560978 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:54.560986 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:54.561045 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:54.561174 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 02:29:54.561265 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:29:54.564200 18779 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43028:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 02:29:54.567274 18779 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 02:29:54.581615 19413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.575531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:39395 (local address 127.0.0.1:51214)
0809 02:29:54.575891 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:54.575937 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:54.576056 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:54.576810 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:54.576817 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:54.576841 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:54.576979 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.576987 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.578466 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.578470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.579792 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.579802 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.581074 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.581077 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.581166 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.581194 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 02:29:54.581329 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 02:29:54.581454 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":105,"threads_started":1}
I20260809 02:29:54.581629 19414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.575666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51214 (local address 127.21.214.131:39395)
0809 02:29:54.575982 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:54.575993 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:54.576021 (+ 28us) server_negotiation.cc:407] Connection header received
0809 02:29:54.576233 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:54.576241 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:54.576450 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:54.576617 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:54.577140 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.578320 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.579901 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.580751 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.580865 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.581018 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:54.581366 (+ 348us) server_negotiation.cc:299] Negotiation successful
0809 02:29:54.581471 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":123,"threads_started":1}
I20260809 02:29:54.581897 19416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.576612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:35259 (local address 127.0.0.1:38506)
0809 02:29:54.577164 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:54.577178 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:54.577279 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:54.578017 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:54.578020 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:54.578039 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:54.578120 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.578125 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.579580 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.579583 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.580458 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.580467 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.581484 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.581488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.581578 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.581608 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 02:29:54.581664 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 02:29:54.581759 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"mutex_wait_us":36,"thread_start_us":138,"threads_started":1}
I20260809 02:29:54.582782 19417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.576483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56216 (local address 127.21.214.129:37175)
0809 02:29:54.576879 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:54.576893 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:54.577263 (+ 370us) server_negotiation.cc:407] Connection header received
0809 02:29:54.577344 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:54.577349 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:54.577526 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:54.577696 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:54.577945 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.578867 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.580841 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.581636 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.581753 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.581919 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:54.582503 (+ 584us) server_negotiation.cc:299] Negotiation successful
0809 02:29:54.582611 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":143,"threads_started":1}
I20260809 02:29:54.582804 19419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.577111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38506 (local address 127.21.214.130:35259)
0809 02:29:54.577528 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:54.577537 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:54.577556 (+ 19us) server_negotiation.cc:407] Connection header received
0809 02:29:54.577618 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:54.577621 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:54.577834 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:54.578028 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:54.578253 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.579442 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.580585 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.581335 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.582027 (+ 692us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.582492 (+ 465us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:54.582539 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 02:29:54.582620 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":128,"threads_started":1}
I20260809 02:29:54.583125 19418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.576301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:37175 (local address 127.0.0.1:56216)
0809 02:29:54.577057 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:54.577071 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:54.577165 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:54.577703 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:54.577707 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:54.577725 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:54.577816 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.577822 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.579380 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.579384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.580680 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.580692 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.581991 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.581995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.582082 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.582109 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 02:29:54.582184 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 02:29:54.582283 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"mutex_wait_us":1,"thread_start_us":94,"threads_started":1}
I20260809 02:29:54.585165 19307 tablet_service.cc:1467] Processing CreateTablet for tablet 97c353d63b3d4d53a12f286474cbdadb (DEFAULT_TABLE table=test-table [id=0d8f55ad48b14138b0ff49633617df04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:54.585579 19121 tablet_service.cc:1467] Processing CreateTablet for tablet 97c353d63b3d4d53a12f286474cbdadb (DEFAULT_TABLE table=test-table [id=0d8f55ad48b14138b0ff49633617df04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:54.586295 19307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97c353d63b3d4d53a12f286474cbdadb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:54.585956 18946 tablet_service.cc:1467] Processing CreateTablet for tablet 97c353d63b3d4d53a12f286474cbdadb (DEFAULT_TABLE table=test-table [id=0d8f55ad48b14138b0ff49633617df04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 02:29:54.586720 19121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97c353d63b3d4d53a12f286474cbdadb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:54.587003 18946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97c353d63b3d4d53a12f286474cbdadb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:54.592960 19420 tablet_bootstrap.cc:492] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861: Bootstrap starting.
I20260809 02:29:54.594590 19421 tablet_bootstrap.cc:492] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06: Bootstrap starting.
I20260809 02:29:54.595001 19423 tablet_bootstrap.cc:492] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8: Bootstrap starting.
I20260809 02:29:54.595562 19420 tablet_bootstrap.cc:654] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:54.596323 19420 log.cc:824] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:54.596897 19423 tablet_bootstrap.cc:654] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:54.597800 19423 log.cc:824] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:54.598630 19420 tablet_bootstrap.cc:492] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861: No bootstrap required, opened a new log
I20260809 02:29:54.598835 19420 ts_tablet_manager.cc:1397] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 02:29:54.599222 19421 tablet_bootstrap.cc:654] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:54.599776 19423 tablet_bootstrap.cc:492] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8: No bootstrap required, opened a new log
I20260809 02:29:54.599987 19423 ts_tablet_manager.cc:1397] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 02:29:54.600078 19421 log.cc:824] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:54.602144 19421 tablet_bootstrap.cc:492] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06: No bootstrap required, opened a new log
I20260809 02:29:54.602344 19421 ts_tablet_manager.cc:1397] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260809 02:29:54.603497 19420 raft_consensus.cc:348] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c8675bd838e48cca10ce328e02e0861" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 39395 } } peers { permanent_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 37175 } } peers { permanent_uuid: "6041097c03c44f7da869768ed6925d06" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35259 } }
I20260809 02:29:54.603608 19423 raft_consensus.cc:348] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c8675bd838e48cca10ce328e02e0861" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 39395 } } peers { permanent_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 37175 } } peers { permanent_uuid: "6041097c03c44f7da869768ed6925d06" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35259 } }
I20260809 02:29:54.603881 19420 raft_consensus.cc:374] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:54.603986 19423 raft_consensus.cc:374] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:54.603997 19420 raft_consensus.cc:729] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c8675bd838e48cca10ce328e02e0861, State: Initialized, Role: FOLLOWER
I20260809 02:29:54.604139 19423 raft_consensus.cc:729] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e8edcdb3d37453a847ea6dcc6b289c8, State: Initialized, Role: FOLLOWER
I20260809 02:29:54.604647 19423 consensus_queue.cc:260] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c8675bd838e48cca10ce328e02e0861" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 39395 } } peers { permanent_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 37175 } } peers { permanent_uuid: "6041097c03c44f7da869768ed6925d06" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35259 } }
I20260809 02:29:54.604645 19420 consensus_queue.cc:260] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c8675bd838e48cca10ce328e02e0861" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 39395 } } peers { permanent_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 37175 } } peers { permanent_uuid: "6041097c03c44f7da869768ed6925d06" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35259 } }
I20260809 02:29:54.605408 19398 heartbeater.cc:503] Master 127.21.214.190:33647 was elected leader, sending a full tablet report...
I20260809 02:29:54.605736 19420 ts_tablet_manager.cc:1428] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260809 02:29:54.606791 19033 heartbeater.cc:503] Master 127.21.214.190:33647 was elected leader, sending a full tablet report...
I20260809 02:29:54.607095 19421 raft_consensus.cc:348] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c8675bd838e48cca10ce328e02e0861" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 39395 } } peers { permanent_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 37175 } } peers { permanent_uuid: "6041097c03c44f7da869768ed6925d06" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35259 } }
I20260809 02:29:54.607352 19421 raft_consensus.cc:374] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:54.607460 19421 raft_consensus.cc:729] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6041097c03c44f7da869768ed6925d06, State: Initialized, Role: FOLLOWER
I20260809 02:29:54.606786 19423 ts_tablet_manager.cc:1428] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260809 02:29:54.607936 19421 consensus_queue.cc:260] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c8675bd838e48cca10ce328e02e0861" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 39395 } } peers { permanent_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 37175 } } peers { permanent_uuid: "6041097c03c44f7da869768ed6925d06" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35259 } }
I20260809 02:29:54.608804 19213 heartbeater.cc:503] Master 127.21.214.190:33647 was elected leader, sending a full tablet report...
I20260809 02:29:54.609867 19421 ts_tablet_manager.cc:1428] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06: Time spent starting tablet: real 0.007s user 0.005s sys 0.003s
W20260809 02:29:54.646266 19035 tablet.cc:2369] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:29:54.789628 19399 tablet.cc:2369] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 02:29:54.843926 19214 tablet.cc:2369] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 02:29:54.918001 19432 raft_consensus.cc:482] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 02:29:54.918301 19432 raft_consensus.cc:504] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c8675bd838e48cca10ce328e02e0861" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 39395 } } peers { permanent_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 37175 } } peers { permanent_uuid: "6041097c03c44f7da869768ed6925d06" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35259 } }
I20260809 02:29:54.919668 19432 leader_election.cc:288] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c8675bd838e48cca10ce328e02e0861 (127.21.214.131:39395), 6041097c03c44f7da869768ed6925d06 (127.21.214.130:35259)
I20260809 02:29:54.924302 19419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.920620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:38587 (local address 127.21.214.130:35259)
0809 02:29:54.920757 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:54.920762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:54.920882 (+ 120us) server_negotiation.cc:407] Connection header received
0809 02:29:54.921058 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:54.921061 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:54.921119 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:54.921216 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:54.921456 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.922171 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.923318 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.923714 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.923840 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.923890 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:54.924116 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 02:29:54.924183 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 02:29:54.924326 19437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.920424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.130:35259 (local address 127.21.214.129:38587)
0809 02:29:54.920759 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:54.920776 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:54.920931 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:54.921231 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:54.921233 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:54.921245 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:54.921334 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.921338 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.922291 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.922296 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.923174 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.923184 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.923837 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.923840 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.923943 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.923996 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 02:29:54.924087 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 02:29:54.924160 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":45,"thread_start_us":94,"threads_started":1}
I20260809 02:29:54.924451 19414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.920069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.21.214.129:40781 (local address 127.21.214.131:39395)
0809 02:29:54.920253 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:54.920257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:54.920476 (+ 219us) server_negotiation.cc:407] Connection header received
0809 02:29:54.920697 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:54.920704 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:54.920771 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:54.920821 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 02:29:54.921208 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.922024 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.923314 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.923782 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.923939 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.923996 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:54.924205 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 02:29:54.924291 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 02:29:54.924635 19435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:54.919958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.131:39395 (local address 127.21.214.129:40781)
0809 02:29:54.920347 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:54.920365 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:29:54.920498 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:29:54.920962 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:29:54.920965 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:29:54.920983 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 02:29:54.921086 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.921090 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.922141 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.922143 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.923160 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:29:54.923171 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:29:54.923939 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:29:54.923943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:29:54.924067 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:54.924087 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 02:29:54.924185 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 02:29:54.924271 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":7,"thread_start_us":107,"threads_started":1}
I20260809 02:29:54.925328 19147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97c353d63b3d4d53a12f286474cbdadb" candidate_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6041097c03c44f7da869768ed6925d06" is_pre_election: true
I20260809 02:29:54.925369 19331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97c353d63b3d4d53a12f286474cbdadb" candidate_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c8675bd838e48cca10ce328e02e0861" is_pre_election: true
I20260809 02:29:54.925647 19147 raft_consensus.cc:2454] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e8edcdb3d37453a847ea6dcc6b289c8 in term 0.
I20260809 02:29:54.925673 19331 raft_consensus.cc:2454] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e8edcdb3d37453a847ea6dcc6b289c8 in term 0.
I20260809 02:29:54.926206 18882 leader_election.cc:302] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6041097c03c44f7da869768ed6925d06, 6e8edcdb3d37453a847ea6dcc6b289c8; no voters:
I20260809 02:29:54.926548 19432 raft_consensus.cc:2781] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 02:29:54.926657 19432 raft_consensus.cc:482] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 02:29:54.926712 19432 raft_consensus.cc:3037] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:54.927858 19432 raft_consensus.cc:504] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c8675bd838e48cca10ce328e02e0861" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 39395 } } peers { permanent_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 37175 } } peers { permanent_uuid: "6041097c03c44f7da869768ed6925d06" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35259 } }
I20260809 02:29:54.928243 19432 leader_election.cc:288] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [CANDIDATE]: Term 1 election: Requested vote from peers 4c8675bd838e48cca10ce328e02e0861 (127.21.214.131:39395), 6041097c03c44f7da869768ed6925d06 (127.21.214.130:35259)
I20260809 02:29:54.928702 19147 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97c353d63b3d4d53a12f286474cbdadb" candidate_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6041097c03c44f7da869768ed6925d06"
I20260809 02:29:54.928709 19331 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97c353d63b3d4d53a12f286474cbdadb" candidate_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c8675bd838e48cca10ce328e02e0861"
I20260809 02:29:54.928850 19147 raft_consensus.cc:3037] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:54.928850 19331 raft_consensus.cc:3037] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:54.930254 19331 raft_consensus.cc:2454] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e8edcdb3d37453a847ea6dcc6b289c8 in term 1.
I20260809 02:29:54.930261 19147 raft_consensus.cc:2454] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e8edcdb3d37453a847ea6dcc6b289c8 in term 1.
I20260809 02:29:54.930653 18882 leader_election.cc:302] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c8675bd838e48cca10ce328e02e0861, 6e8edcdb3d37453a847ea6dcc6b289c8; no voters:
I20260809 02:29:54.930855 19432 raft_consensus.cc:2781] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:54.931133 19432 raft_consensus.cc:686] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [term 1 LEADER]: Becoming Leader. State: Replica: 6e8edcdb3d37453a847ea6dcc6b289c8, State: Running, Role: LEADER
I20260809 02:29:54.931495 19432 consensus_queue.cc:237] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c8675bd838e48cca10ce328e02e0861" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 39395 } } peers { permanent_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 37175 } } peers { permanent_uuid: "6041097c03c44f7da869768ed6925d06" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35259 } }
I20260809 02:29:54.934902 18779 catalog_manager.cc:5495] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e8edcdb3d37453a847ea6dcc6b289c8 (127.21.214.129). New cstate: current_term: 1 leader_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c8675bd838e48cca10ce328e02e0861" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 39395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e8edcdb3d37453a847ea6dcc6b289c8" member_type: VOTER last_known_addr { host: "127.21.214.129" port: 37175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6041097c03c44f7da869768ed6925d06" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35259 } health_report { overall_health: UNKNOWN } } }
I20260809 02:29:55.032604 19417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:55.028945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56226 (local address 127.21.214.129:37175)
0809 02:29:55.029098 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:55.029102 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:55.029119 (+ 17us) server_negotiation.cc:407] Connection header received
0809 02:29:55.029218 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:55.029226 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:55.029286 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:55.029407 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:29:55.029655 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:55.030169 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:55.031137 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:55.031368 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:55.031484 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:55.031795 (+ 311us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:29:55.032207 (+ 412us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:29:55.032359 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:55.032400 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 02:29:55.032455 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 02:29:55.039153 19331 raft_consensus.cc:1261] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861 [term 1 FOLLOWER]: Refusing update from remote peer 6e8edcdb3d37453a847ea6dcc6b289c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:55.039153 19147 raft_consensus.cc:1261] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06 [term 1 FOLLOWER]: Refusing update from remote peer 6e8edcdb3d37453a847ea6dcc6b289c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:29:55.040010 19438 consensus_queue.cc:1035] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6041097c03c44f7da869768ed6925d06" member_type: VOTER last_known_addr { host: "127.21.214.130" port: 35259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:55.040320 19432 consensus_queue.cc:1035] T 97c353d63b3d4d53a12f286474cbdadb P 6e8edcdb3d37453a847ea6dcc6b289c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c8675bd838e48cca10ce328e02e0861" member_type: VOTER last_known_addr { host: "127.21.214.131" port: 39395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:29:55.048285 19442 mvcc.cc:205] Tried to move back new op lower bound from 7316449669271838720 to 7316449668842332160. Current Snapshot: MvccSnapshot[applied={T|T < 7316449669271838720}]
I20260809 02:29:55.048633 19441 mvcc.cc:205] Tried to move back new op lower bound from 7316449669271838720 to 7316449668842332160. Current Snapshot: MvccSnapshot[applied={T|T < 7316449669271838720}]
I20260809 02:29:55.059347 18778 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:55.059540 18778 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 02:29:55.062247 18778 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5536389bde7840bb87e602bd2de77b38: Sending DeleteTablet for 3 replicas of tablet 97c353d63b3d4d53a12f286474cbdadb
I20260809 02:29:55.063060 19307 tablet_service.cc:1514] Processing DeleteTablet for tablet 97c353d63b3d4d53a12f286474cbdadb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:55 UTC) from {username='slave'} at 127.0.0.1:51214
I20260809 02:29:55.063194 19121 tablet_service.cc:1514] Processing DeleteTablet for tablet 97c353d63b3d4d53a12f286474cbdadb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:55 UTC) from {username='slave'} at 127.0.0.1:38506
I20260809 02:29:55.063380 18946 tablet_service.cc:1514] Processing DeleteTablet for tablet 97c353d63b3d4d53a12f286474cbdadb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 02:29:55 UTC) from {username='slave'} at 127.0.0.1:56216
I20260809 02:29:55.063745 19458 tablet_replica.cc:330] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06: stopping tablet replica
I20260809 02:29:55.063814 19457 tablet_replica.cc:330] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861: stopping tablet replica
I20260809 02:29:55.064144 19458 raft_consensus.cc:2229] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:29:55.064208 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 18858
I20260809 02:29:55.064186 19457 raft_consensus.cc:2229] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 02:29:55.064525 19458 raft_consensus.cc:2258] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:55.066257 19458 ts_tablet_manager.cc:1905] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:55.067739 19457 raft_consensus.cc:2258] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 02:29:55.071008 19457 ts_tablet_manager.cc:1905] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 02:29:55.071549 19458 ts_tablet_manager.cc:1918] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:55.071671 19458 log.cc:1196] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-1/wal/wals/97c353d63b3d4d53a12f286474cbdadb
I20260809 02:29:55.072041 19458 ts_tablet_manager.cc:1939] T 97c353d63b3d4d53a12f286474cbdadb P 6041097c03c44f7da869768ed6925d06: Deleting consensus metadata
I20260809 02:29:55.073559 18758 catalog_manager.cc:4841] TS 6041097c03c44f7da869768ed6925d06 (127.21.214.130:35259): tablet 97c353d63b3d4d53a12f286474cbdadb (table test-table [id=0d8f55ad48b14138b0ff49633617df04]) successfully deleted
I20260809 02:29:55.073957 19457 ts_tablet_manager.cc:1918] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 02:29:55.074050 19457 log.cc:1196] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861: Deleting WAL directory at /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786242328272206-22362-0/minicluster-data/ts-2/wal/wals/97c353d63b3d4d53a12f286474cbdadb
I20260809 02:29:55.074398 19457 ts_tablet_manager.cc:1939] T 97c353d63b3d4d53a12f286474cbdadb P 4c8675bd838e48cca10ce328e02e0861: Deleting consensus metadata
I20260809 02:29:55.075573 18758 catalog_manager.cc:4841] TS 4c8675bd838e48cca10ce328e02e0861 (127.21.214.131:39395): tablet 97c353d63b3d4d53a12f286474cbdadb (table test-table [id=0d8f55ad48b14138b0ff49633617df04]) successfully deleted
W20260809 02:29:55.076906 18758 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.21.214.129:37175 (error 108)
I20260809 02:29:55.077011 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 19037
I20260809 02:29:55.087301 19465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:55.086741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.129:37175 (local address 127.0.0.1:56234)
0809 02:29:55.087029 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 02:29:55.087143 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.129:37175: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":62,"threads_started":1}
W20260809 02:29:55.087532 18758 catalog_manager.cc:4584] TS 6e8edcdb3d37453a847ea6dcc6b289c8 (127.21.214.129:37175): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 97c353d63b3d4d53a12f286474cbdadb: Network error: Client connection negotiation failed: client connection to 127.21.214.129:37175: connect: Connection refused (error 111)
I20260809 02:29:55.092530 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 19217
I20260809 02:29:55.105489 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 18728
2026-08-09T02:29:55Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1432 ms)
[----------] 6 tests from EncryptionPolicyTest (12007 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:29:55 dist-test-slave-68xk krb5kdc[19470](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:29:55 dist-test-slave-68xk krb5kdc[19470](info): set up 2 sockets
Aug 09 02:29:55 dist-test-slave-68xk krb5kdc[19470](info): commencing operation
krb5kdc: starting...
W20260809 02:29:56.390873 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:29:56 dist-test-slave-68xk krb5kdc[19470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:29:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:29:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:29:56.521906 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36327
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:56.636034 19489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:56.636330 19489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:56.636431 19489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:56.640533 19489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:29:56.640630 19489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:56.640673 19489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:56.640728 19489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:29:56.640769 19489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:29:56.646023 19489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36327
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:56.647152 19489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:56.648185 19489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:56.657297 19500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:56.657337 19498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:56.657281 19495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:56.657480 19489 server_base.cc:1034] running on GCE node
I20260809 02:29:56.658120 19489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:56.659282 19489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:56.660564 19489 hybrid_clock.cc:648] HybridClock initialized: now 1786242596660535 us; error 40 us; skew 500 ppm
Aug 09 02:29:56 dist-test-slave-68xk krb5kdc[19470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242596, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:56.663496 19489 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:29:56.664328 19489 webserver.cc:460] Webserver started at http://127.0.0.1:41055/ using document root <none> and password file <none>
I20260809 02:29:56.664846 19489 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:56.664904 19489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:56.665077 19489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:56.667166 19489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "672206e131ce4a8f90cefa5a530a0036"
format_stamp: "Formatted at 2026-08-09 02:29:56 on dist-test-slave-68xk"
server_key: "d154f0f808c06b9822c9d827060de1a5"
server_key_iv: "528715ca71395b6008d1a3c680e1cc68"
server_key_version: "encryptionkey@0"
I20260809 02:29:56.667686 19489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "672206e131ce4a8f90cefa5a530a0036"
format_stamp: "Formatted at 2026-08-09 02:29:56 on dist-test-slave-68xk"
server_key: "d154f0f808c06b9822c9d827060de1a5"
server_key_iv: "528715ca71395b6008d1a3c680e1cc68"
server_key_version: "encryptionkey@0"
I20260809 02:29:56.671448 19489 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:29:56.673894 19513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:56.675257 19489 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:29:56.675393 19489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "672206e131ce4a8f90cefa5a530a0036"
format_stamp: "Formatted at 2026-08-09 02:29:56 on dist-test-slave-68xk"
server_key: "d154f0f808c06b9822c9d827060de1a5"
server_key_iv: "528715ca71395b6008d1a3c680e1cc68"
server_key_version: "encryptionkey@0"
I20260809 02:29:56.675504 19489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:56.695536 19489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:56.698873 19489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:56.699090 19489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:56.706674 19489 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36327
I20260809 02:29:56.706710 19593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36327 every 8 connection(s)
I20260809 02:29:56.707759 19489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:29:56.708890 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 19489
I20260809 02:29:56.709040 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:29:56.709380 22362 external_mini_cluster.cc:1428] Setting key fb7edad222ea41b208e3f20d2c27cb8f
I20260809 02:29:56.711100 19596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:56.716634 19596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036: Bootstrap starting.
Aug 09 02:29:56 dist-test-slave-68xk krb5kdc[19470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:29:56.718963 19596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:56.719901 19596 log.cc:824] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:56.721776 19596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036: No bootstrap required, opened a new log
I20260809 02:29:56.723649 19602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:56.710929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44835 (local address 127.0.0.1:36327)
0809 02:29:56.711394 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:56.711409 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:56.711446 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:29:56.712071 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:56.712088 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:56.712445 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:56.712785 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:56.713620 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:56.714683 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:56.715542 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:56.716011 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:56.716184 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:56.718882 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:56.718887 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:56.718900 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:56.718927 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:56.720660 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:56.721190 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:56.721195 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:56.721199 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:56.721335 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:56.721701 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:56.721709 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:56.721711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:56.722149 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:56.722381 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:56.722726 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 02:29:56.722948 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":136,"threads_started":1}
I20260809 02:29:56.725778 19596 raft_consensus.cc:348] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "672206e131ce4a8f90cefa5a530a0036" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36327 } }
I20260809 02:29:56.726033 19596 raft_consensus.cc:374] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:56.726114 19596 raft_consensus.cc:729] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 672206e131ce4a8f90cefa5a530a0036, State: Initialized, Role: FOLLOWER
I20260809 02:29:56.726621 19596 consensus_queue.cc:260] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "672206e131ce4a8f90cefa5a530a0036" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36327 } }
I20260809 02:29:56.726794 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:29:56.726784 19596 raft_consensus.cc:388] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:29:56.726859 19596 raft_consensus.cc:482] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:29:56.726954 19596 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:56.728080 19596 raft_consensus.cc:504] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "672206e131ce4a8f90cefa5a530a0036" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36327 } }
I20260809 02:29:56.728495 19596 leader_election.cc:302] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 672206e131ce4a8f90cefa5a530a0036; no voters:
I20260809 02:29:56.728826 19596 leader_election.cc:288] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:29:56.728962 19610 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:56.729238 19610 raft_consensus.cc:686] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [term 1 LEADER]: Becoming Leader. State: Replica: 672206e131ce4a8f90cefa5a530a0036, State: Running, Role: LEADER
I20260809 02:29:56.729630 19610 consensus_queue.cc:237] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "672206e131ce4a8f90cefa5a530a0036" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36327 } }
I20260809 02:29:56.730157 19596 sys_catalog.cc:564] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:29:56.731498 19613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "672206e131ce4a8f90cefa5a530a0036" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "672206e131ce4a8f90cefa5a530a0036" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36327 } } }
I20260809 02:29:56.731622 19613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:56.731992 19615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 672206e131ce4a8f90cefa5a530a0036. Latest consensus state: current_term: 1 leader_uuid: "672206e131ce4a8f90cefa5a530a0036" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "672206e131ce4a8f90cefa5a530a0036" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36327 } } }
I20260809 02:29:56.732169 19615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036 [sys.catalog]: This master's current role is: LEADER
W20260809 02:29:56.735896 19634 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:29:56.735986 19634 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:29:56.736059 19627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:29:56.737080 19627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:29:56.739279 19602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:56.729223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39309 (local address 127.0.0.1:36327)
0809 02:29:56.729342 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:56.729346 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:56.729840 (+ 494us) server_negotiation.cc:407] Connection header received
0809 02:29:56.730026 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:56.730029 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:56.730077 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:56.730155 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:56.731122 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:56.731953 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:56.733177 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:56.733503 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:56.733581 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:56.735392 (+ 1811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:56.735395 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:56.735398 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:29:56.735423 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:56.737104 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:56.737695 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:56.737698 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:56.737700 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:56.737800 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:29:56.738204 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:29:56.738208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:29:56.738209 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:29:56.738453 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:56.738580 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:56.739032 (+ 452us) server_negotiation.cc:299] Negotiation successful
0809 02:29:56.739140 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 02:29:56.742974 19627 catalog_manager.cc:1347] Generated new cluster ID: 3cf4284ce24c4667be00006b4b9c37f6
I20260809 02:29:56.743036 19627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:29:56.771884 19627 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:29:56.773097 19627 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:29:56.778604 19627 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 672206e131ce4a8f90cefa5a530a0036: Generated new TSK 0
I20260809 02:29:56.779501 19627 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:29:56.795652 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 19489
W20260809 02:29:56.811154 19468 connection.cc:535] client connection to 127.0.0.1:36327 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36327): Connection reset by peer (error 104)
2026-08-09T02:29:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1691 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:29:56 dist-test-slave-68xk krb5kdc[19641](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:29:56 dist-test-slave-68xk krb5kdc[19641](info): set up 2 sockets
Aug 09 02:29:56 dist-test-slave-68xk krb5kdc[19641](info): commencing operation
krb5kdc: starting...
W20260809 02:29:58.028137 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:29:58 dist-test-slave-68xk krb5kdc[19641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:29:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:29:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:29:58.161616 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37891
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37891
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:58.277792 19659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:58.278136 19659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:58.278236 19659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:58.282567 19659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:29:58.282658 19659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:58.282697 19659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:58.282737 19659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:29:58.282771 19659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:29:58.288348 19659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37891
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:58.289529 19659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:58.290705 19659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:58.299446 19670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:58.299450 19667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:58.299474 19666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:58.299746 19659 server_base.cc:1034] running on GCE node
I20260809 02:29:58.300418 19659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:58.301517 19659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:58.302683 19659 hybrid_clock.cc:648] HybridClock initialized: now 1786242598302656 us; error 38 us; skew 500 ppm
Aug 09 02:29:58 dist-test-slave-68xk krb5kdc[19641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242598, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:58.310236 19659 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:29:58.311197 19659 webserver.cc:460] Webserver started at http://127.0.0.1:34555/ using document root <none> and password file <none>
I20260809 02:29:58.311791 19659 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:58.311890 19659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:58.312139 19659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:58.314180 19659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "10d77c628f7a4271b5647acc3ffc0b46"
format_stamp: "Formatted at 2026-08-09 02:29:58 on dist-test-slave-68xk"
server_key: "5ef92924bfdc9b8d4601464200b29502"
server_key_iv: "8540da079e43c3b2912bdd5083051b59"
server_key_version: "encryptionkey@0"
I20260809 02:29:58.314813 19659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "10d77c628f7a4271b5647acc3ffc0b46"
format_stamp: "Formatted at 2026-08-09 02:29:58 on dist-test-slave-68xk"
server_key: "5ef92924bfdc9b8d4601464200b29502"
server_key_iv: "8540da079e43c3b2912bdd5083051b59"
server_key_version: "encryptionkey@0"
I20260809 02:29:58.318581 19659 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:29:58.320988 19681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:58.322183 19659 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:29:58.322336 19659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "10d77c628f7a4271b5647acc3ffc0b46"
format_stamp: "Formatted at 2026-08-09 02:29:58 on dist-test-slave-68xk"
server_key: "5ef92924bfdc9b8d4601464200b29502"
server_key_iv: "8540da079e43c3b2912bdd5083051b59"
server_key_version: "encryptionkey@0"
I20260809 02:29:58.322474 19659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:58.335742 19659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:58.338624 19659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:58.338829 19659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:58.346009 19659 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37891
I20260809 02:29:58.346032 19753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37891 every 8 connection(s)
I20260809 02:29:58.346985 19659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:29:58.348556 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 19659
I20260809 02:29:58.348768 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:29:58.349109 22362 external_mini_cluster.cc:1428] Setting key 74d3030e95f6b1a76c2b6c682a98bf28
I20260809 02:29:58.350283 19755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:58.356303 19755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46: Bootstrap starting.
I20260809 02:29:58.357851 19760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:58.350585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43533 (local address 127.0.0.1:37891)
0809 02:29:58.351044 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:58.351059 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:58.351093 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:29:58.351716 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:58.351730 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:58.352036 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:58.352355 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:58.352750 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:58.353692 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:58.354658 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:58.355114 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:58.355287 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:58.356229 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:58.356234 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:58.356245 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:58.356660 (+ 415us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:58.356719 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:58.356741 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:58.356881 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:58.357063 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 02:29:58.357193 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":159,"threads_started":1}
I20260809 02:29:58.358860 19755 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:58.359814 19755 log.cc:824] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:58.360991 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:29:58.362027 19755 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46: No bootstrap required, opened a new log
I20260809 02:29:58.366117 19755 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d77c628f7a4271b5647acc3ffc0b46" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37891 } }
I20260809 02:29:58.366403 19755 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:58.366499 19755 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d77c628f7a4271b5647acc3ffc0b46, State: Initialized, Role: FOLLOWER
I20260809 02:29:58.367043 19755 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d77c628f7a4271b5647acc3ffc0b46" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37891 } }
I20260809 02:29:58.367262 19755 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:29:58.367348 19755 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:29:58.367461 19755 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:58.367755 19760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:58.362987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47173 (local address 127.0.0.1:37891)
0809 02:29:58.363091 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:58.363095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:58.363254 (+ 159us) server_negotiation.cc:407] Connection header received
0809 02:29:58.363370 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:58.363372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:58.363405 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:58.363467 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:58.363775 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:58.364761 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:58.366001 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:29:58.366212 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:29:58.366285 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:29:58.367171 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:58.367174 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:58.367176 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:58.367186 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:58.367235 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:58.367252 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:58.367367 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:58.367528 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 02:29:58.367580 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:29:58.368654 19755 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d77c628f7a4271b5647acc3ffc0b46" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37891 } }
I20260809 02:29:58.369020 19755 leader_election.cc:302] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10d77c628f7a4271b5647acc3ffc0b46; no voters:
I20260809 02:29:58.369350 19755 leader_election.cc:288] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:29:58.369462 19769 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:58.369706 19769 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [term 1 LEADER]: Becoming Leader. State: Replica: 10d77c628f7a4271b5647acc3ffc0b46, State: Running, Role: LEADER
I20260809 02:29:58.370028 19769 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d77c628f7a4271b5647acc3ffc0b46" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37891 } }
I20260809 02:29:58.370654 19755 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:29:58.371719 19771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10d77c628f7a4271b5647acc3ffc0b46. Latest consensus state: current_term: 1 leader_uuid: "10d77c628f7a4271b5647acc3ffc0b46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d77c628f7a4271b5647acc3ffc0b46" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37891 } } }
I20260809 02:29:58.371852 19771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:58.372195 19770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10d77c628f7a4271b5647acc3ffc0b46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d77c628f7a4271b5647acc3ffc0b46" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37891 } } }
I20260809 02:29:58.372344 19770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46 [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:58.373042 19779 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:29:58.375785 19779 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:29:58.380968 19779 catalog_manager.cc:1347] Generated new cluster ID: 9c939e590d6248e083e6e66eaa11bc11
I20260809 02:29:58.381032 19779 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:29:58.401176 19779 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:29:58.402114 19779 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:29:58.407676 19779 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10d77c628f7a4271b5647acc3ffc0b46: Generated new TSK 0
I20260809 02:29:58.408514 19779 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:29:58.421779 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 19659
W20260809 02:29:58.435478 19639 connection.cc:535] client connection to 127.0.0.1:37891 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37891): Connection reset by peer (error 104)
2026-08-09T02:29:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1624 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:29:58 dist-test-slave-68xk krb5kdc[19793](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:29:58 dist-test-slave-68xk krb5kdc[19793](info): set up 2 sockets
Aug 09 02:29:58 dist-test-slave-68xk krb5kdc[19793](info): commencing operation
krb5kdc: starting...
W20260809 02:29:59.651036 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:29:59 dist-test-slave-68xk krb5kdc[19793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:29:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:29:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:29:59.781924 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45061
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:29:59.895627 19809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:29:59.895929 19809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:29:59.896004 19809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:29:59.900146 19809 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:29:59.900238 19809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:29:59.900277 19809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:29:59.900338 19809 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:29:59.900379 19809 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:29:59.905689 19809 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45061
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:29:59.906885 19809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:29:59.907948 19809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:29:59.916714 19819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:59.916702 19815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:29:59.916728 19816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:29:59.917232 19809 server_base.cc:1034] running on GCE node
I20260809 02:29:59.917733 19809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:29:59.918890 19809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:29:59.920125 19809 hybrid_clock.cc:648] HybridClock initialized: now 1786242599920088 us; error 52 us; skew 500 ppm
Aug 09 02:29:59 dist-test-slave-68xk krb5kdc[19793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242599, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:29:59.923345 19809 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:29:59.924324 19809 webserver.cc:460] Webserver started at http://127.0.0.1:45999/ using document root <none> and password file <none>
I20260809 02:29:59.924891 19809 fs_manager.cc:359] Metadata directory not provided
I20260809 02:29:59.924957 19809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:29:59.925158 19809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:29:59.927425 19809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "cb3dfe9ac7da4c70a0642162c0afc760"
format_stamp: "Formatted at 2026-08-09 02:29:59 on dist-test-slave-68xk"
server_key: "1cea3f01ca296164b0b66aa9c5eaf42a"
server_key_iv: "637c0ce343ee183e9e7d4ba2247e6b6e"
server_key_version: "encryptionkey@0"
I20260809 02:29:59.928015 19809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "cb3dfe9ac7da4c70a0642162c0afc760"
format_stamp: "Formatted at 2026-08-09 02:29:59 on dist-test-slave-68xk"
server_key: "1cea3f01ca296164b0b66aa9c5eaf42a"
server_key_iv: "637c0ce343ee183e9e7d4ba2247e6b6e"
server_key_version: "encryptionkey@0"
I20260809 02:29:59.932157 19809 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:29:59.934696 19831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:29:59.936051 19809 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:29:59.936167 19809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "cb3dfe9ac7da4c70a0642162c0afc760"
format_stamp: "Formatted at 2026-08-09 02:29:59 on dist-test-slave-68xk"
server_key: "1cea3f01ca296164b0b66aa9c5eaf42a"
server_key_iv: "637c0ce343ee183e9e7d4ba2247e6b6e"
server_key_version: "encryptionkey@0"
I20260809 02:29:59.936259 19809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:29:59.941068 19809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:29:59.944442 19809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:29:59.944607 19809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:29:59.952365 19809 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45061
I20260809 02:29:59.952415 19905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45061 every 8 connection(s)
I20260809 02:29:59.953354 19809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:29:59.956355 19906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:29:59.958395 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 19809
I20260809 02:29:59.958575 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:29:59.958925 22362 external_mini_cluster.cc:1428] Setting key 36c0152be0034b4e9a9c4083efc0de00
I20260809 02:29:59.963738 19906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760: Bootstrap starting.
I20260809 02:29:59.964493 19909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:59.960569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32951 (local address 127.0.0.1:45061)
0809 02:29:59.961058 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:59.961073 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:59.961110 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:29:59.961774 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:59.961790 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:59.962066 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:59.962414 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:59.963270 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:59.963275 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:59.963286 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:59.963296 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:59.963350 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:59.963371 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:59.963522 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:59.963594 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 02:29:59.963767 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":166,"threads_started":1}
I20260809 02:29:59.966228 19906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760: Neither blocks nor log segments found. Creating new log.
I20260809 02:29:59.967185 19906 log.cc:824] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760: Log is configured to *not* fsync() on all Append() calls
I20260809 02:29:59.967381 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:29:59.969322 19906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760: No bootstrap required, opened a new log
I20260809 02:29:59.971289 19909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:29:59.969480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43665 (local address 127.0.0.1:45061)
0809 02:29:59.969605 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 02:29:59.969610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:29:59.969888 (+ 278us) server_negotiation.cc:407] Connection header received
0809 02:29:59.970013 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:29:59.970015 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:29:59.970042 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:29:59.970104 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:29:59.970872 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:29:59.970875 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:29:59.970876 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:29:59.970886 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:29:59.970909 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:29:59.970919 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:29:59.970986 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:29:59.971109 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 02:29:59.971140 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:29:59.973875 19906 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3dfe9ac7da4c70a0642162c0afc760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45061 } }
I20260809 02:29:59.974133 19906 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:29:59.974203 19906 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb3dfe9ac7da4c70a0642162c0afc760, State: Initialized, Role: FOLLOWER
I20260809 02:29:59.974711 19906 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3dfe9ac7da4c70a0642162c0afc760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45061 } }
I20260809 02:29:59.974880 19906 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:29:59.974952 19906 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:29:59.975056 19906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:29:59.975998 19906 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3dfe9ac7da4c70a0642162c0afc760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45061 } }
I20260809 02:29:59.976365 19906 leader_election.cc:302] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb3dfe9ac7da4c70a0642162c0afc760; no voters:
I20260809 02:29:59.976722 19906 leader_election.cc:288] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:29:59.976846 19924 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:29:59.977080 19924 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [term 1 LEADER]: Becoming Leader. State: Replica: cb3dfe9ac7da4c70a0642162c0afc760, State: Running, Role: LEADER
I20260809 02:29:59.977485 19924 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3dfe9ac7da4c70a0642162c0afc760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45061 } }
I20260809 02:29:59.978031 19906 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:29:59.979184 19927 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb3dfe9ac7da4c70a0642162c0afc760. Latest consensus state: current_term: 1 leader_uuid: "cb3dfe9ac7da4c70a0642162c0afc760" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3dfe9ac7da4c70a0642162c0afc760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45061 } } }
I20260809 02:29:59.979427 19926 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb3dfe9ac7da4c70a0642162c0afc760" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb3dfe9ac7da4c70a0642162c0afc760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45061 } } }
I20260809 02:29:59.979535 19927 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:59.979571 19926 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760 [sys.catalog]: This master's current role is: LEADER
I20260809 02:29:59.980719 19937 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:29:59.983769 19937 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:29:59.989498 19937 catalog_manager.cc:1347] Generated new cluster ID: 952e97ef04bc42edbabaee9324d7ee37
I20260809 02:29:59.989580 19937 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:29:59.999788 19937 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:00.000102 19937 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:00.006397 19937 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb3dfe9ac7da4c70a0642162c0afc760: Generated new TSK 0
I20260809 02:30:00.007345 19937 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:00.022326 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 19809
2026-08-09T02:30:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1600 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:00 dist-test-slave-68xk krb5kdc[19954](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:00 dist-test-slave-68xk krb5kdc[19954](info): set up 2 sockets
Aug 09 02:30:00 dist-test-slave-68xk krb5kdc[19954](info): commencing operation
krb5kdc: starting...
W20260809 02:30:01.308609 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:01 dist-test-slave-68xk krb5kdc[19954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:30:01.446704 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45089
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45089
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:01.559662 19976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:01.559950 19976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:01.560021 19976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:01.564131 19976 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:01.564215 19976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:01.564254 19976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:01.564309 19976 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:01.564347 19976 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:01.569485 19976 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45089
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:01.570554 19976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:01.571588 19976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:01.580377 19984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:01.580467 19985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:01.580585 19976 server_base.cc:1034] running on GCE node
W20260809 02:30:01.580549 19988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:01.581311 19976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:01.582374 19976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:01.583601 19976 hybrid_clock.cc:648] HybridClock initialized: now 1786242601583571 us; error 44 us; skew 500 ppm
Aug 09 02:30:01 dist-test-slave-68xk krb5kdc[19954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242601, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:01.586755 19976 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:30:01.587713 19976 webserver.cc:460] Webserver started at http://127.0.0.1:45001/ using document root <none> and password file <none>
I20260809 02:30:01.588289 19976 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:01.588383 19976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:01.588629 19976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:01.590715 19976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "4d3390b5859f495bb5b0c443be64525b"
format_stamp: "Formatted at 2026-08-09 02:30:01 on dist-test-slave-68xk"
server_key: "f68c3f35b711c4e1257128f2b42da761"
server_key_iv: "d55b260cb008a5515b25f762d1b6eafb"
server_key_version: "encryptionkey@0"
I20260809 02:30:01.591284 19976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "4d3390b5859f495bb5b0c443be64525b"
format_stamp: "Formatted at 2026-08-09 02:30:01 on dist-test-slave-68xk"
server_key: "f68c3f35b711c4e1257128f2b42da761"
server_key_iv: "d55b260cb008a5515b25f762d1b6eafb"
server_key_version: "encryptionkey@0"
I20260809 02:30:01.595134 19976 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 02:30:01.597546 19996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:01.598882 19976 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 02:30:01.599050 19976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "4d3390b5859f495bb5b0c443be64525b"
format_stamp: "Formatted at 2026-08-09 02:30:01 on dist-test-slave-68xk"
server_key: "f68c3f35b711c4e1257128f2b42da761"
server_key_iv: "d55b260cb008a5515b25f762d1b6eafb"
server_key_version: "encryptionkey@0"
I20260809 02:30:01.599174 19976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:01.619632 19976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:01.622490 19976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:01.622699 19976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:01.630034 19976 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45089
I20260809 02:30:01.630054 20065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45089 every 8 connection(s)
I20260809 02:30:01.631136 19976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:01.633857 20067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:01.634087 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 19976
I20260809 02:30:01.634227 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:01.634613 22362 external_mini_cluster.cc:1428] Setting key dca6151f9d3beecb0f5b02d89e078d4b
I20260809 02:30:01.641063 20067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b: Bootstrap starting.
I20260809 02:30:01.643736 20067 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b: Neither blocks nor log segments found. Creating new log.
Aug 09 02:30:01 dist-test-slave-68xk krb5kdc[19954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:30:01.645030 20067 log.cc:824] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:01.647279 20067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b: No bootstrap required, opened a new log
I20260809 02:30:01.650043 20075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:01.636024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53811 (local address 127.0.0.1:45089)
0809 02:30:01.636442 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:01.636460 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:01.636503 (+ 43us) server_negotiation.cc:407] Connection header received
0809 02:30:01.637301 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:01.637324 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:01.637745 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:01.638107 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:01.638834 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:01.640359 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:01.641322 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:01.641976 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:01.642150 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:01.645434 (+ 3284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:01.645439 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:01.645452 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:01.645511 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:01.647281 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:01.647820 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:01.647825 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:01.647830 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:01.647935 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:01.648247 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:01.648249 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:01.648251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:01.648609 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:01.648758 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:01.649046 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 02:30:01.649325 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":111,"threads_started":1}
I20260809 02:30:01.651424 20067 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d3390b5859f495bb5b0c443be64525b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45089 } }
I20260809 02:30:01.651678 20067 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:01.651757 20067 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3390b5859f495bb5b0c443be64525b, State: Initialized, Role: FOLLOWER
I20260809 02:30:01.652230 20067 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d3390b5859f495bb5b0c443be64525b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45089 } }
I20260809 02:30:01.652405 20067 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:01.652493 20067 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:01.652594 20067 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:01.652938 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:01.653627 20067 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d3390b5859f495bb5b0c443be64525b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45089 } }
I20260809 02:30:01.653967 20067 leader_election.cc:302] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d3390b5859f495bb5b0c443be64525b; no voters:
I20260809 02:30:01.654294 20067 leader_election.cc:288] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:01.654373 20081 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:01.654582 20081 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [term 1 LEADER]: Becoming Leader. State: Replica: 4d3390b5859f495bb5b0c443be64525b, State: Running, Role: LEADER
I20260809 02:30:01.655405 20081 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d3390b5859f495bb5b0c443be64525b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45089 } }
I20260809 02:30:01.655781 20067 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:01.656661 20081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d3390b5859f495bb5b0c443be64525b. Latest consensus state: current_term: 1 leader_uuid: "4d3390b5859f495bb5b0c443be64525b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d3390b5859f495bb5b0c443be64525b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45089 } } }
I20260809 02:30:01.656806 20081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:01.657063 20084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d3390b5859f495bb5b0c443be64525b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d3390b5859f495bb5b0c443be64525b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45089 } } }
I20260809 02:30:01.657169 20084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b [sys.catalog]: This master's current role is: LEADER
W20260809 02:30:01.660917 20102 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:30:01.661051 20102 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:30:01.661137 20095 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:01.662082 20095 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:01.664567 20075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:01.655090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56895 (local address 127.0.0.1:45089)
0809 02:30:01.655247 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:01.655252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:01.655397 (+ 145us) server_negotiation.cc:407] Connection header received
0809 02:30:01.655527 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:01.655531 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:01.655570 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:01.655658 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:01.656340 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:01.657881 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:01.659023 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:01.659347 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:01.659467 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:01.661051 (+ 1584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:01.661054 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:01.661060 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:01.661090 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:01.662777 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:01.663271 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:01.663275 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:01.663276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:01.663362 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:01.663672 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:01.663675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:01.663677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:01.663887 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:01.664021 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:01.664293 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 02:30:01.664403 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 02:30:01.667694 20095 catalog_manager.cc:1347] Generated new cluster ID: 51bff58d85ad40d39fbe7c8deee6fcaa
I20260809 02:30:01.667754 20095 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:01.707242 20095 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:01.708185 20095 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:01.720345 20095 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d3390b5859f495bb5b0c443be64525b: Generated new TSK 0
I20260809 02:30:01.721071 20095 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:01.727533 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 19976
2026-08-09T02:30:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1702 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:01 dist-test-slave-68xk krb5kdc[20114](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:01 dist-test-slave-68xk krb5kdc[20114](info): set up 2 sockets
Aug 09 02:30:01 dist-test-slave-68xk krb5kdc[20114](info): commencing operation
krb5kdc: starting...
W20260809 02:30:02.965586 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:03 dist-test-slave-68xk krb5kdc[20114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:30:03.099931 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41223
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:03.212311 20133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:03.212710 20133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:03.212802 20133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:03.217868 20133 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:03.217927 20133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:03.217947 20133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:03.217988 20133 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:03.218019 20133 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:03.223268 20133 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41223
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:03.224270 20133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:03.225301 20133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:03.234318 20141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:03.234481 20133 server_base.cc:1034] running on GCE node
W20260809 02:30:03.234324 20140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:03.234685 20143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:03.235270 20133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:03.236308 20133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:03.237489 20133 hybrid_clock.cc:648] HybridClock initialized: now 1786242603237469 us; error 30 us; skew 500 ppm
Aug 09 02:30:03 dist-test-slave-68xk krb5kdc[20114](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242603, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:03.240419 20133 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:30:03.241323 20133 webserver.cc:460] Webserver started at http://127.0.0.1:35881/ using document root <none> and password file <none>
I20260809 02:30:03.241885 20133 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:03.241947 20133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:03.242173 20133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:03.244247 20133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "45cc5a192c044b409979201fc0e13979"
format_stamp: "Formatted at 2026-08-09 02:30:03 on dist-test-slave-68xk"
server_key: "66f7d86a9f6390f1c74288ec7536d385"
server_key_iv: "d6e5c0a4962060e10d26c916f573385b"
server_key_version: "encryptionkey@0"
I20260809 02:30:03.244817 20133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "45cc5a192c044b409979201fc0e13979"
format_stamp: "Formatted at 2026-08-09 02:30:03 on dist-test-slave-68xk"
server_key: "66f7d86a9f6390f1c74288ec7536d385"
server_key_iv: "d6e5c0a4962060e10d26c916f573385b"
server_key_version: "encryptionkey@0"
I20260809 02:30:03.248864 20133 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:30:03.251750 20157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:03.253181 20133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 02:30:03.253341 20133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "45cc5a192c044b409979201fc0e13979"
format_stamp: "Formatted at 2026-08-09 02:30:03 on dist-test-slave-68xk"
server_key: "66f7d86a9f6390f1c74288ec7536d385"
server_key_iv: "d6e5c0a4962060e10d26c916f573385b"
server_key_version: "encryptionkey@0"
I20260809 02:30:03.253468 20133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:03.274785 20133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:03.278668 20133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:03.278910 20133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:03.287123 20133 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41223
I20260809 02:30:03.287168 20228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41223 every 8 connection(s)
I20260809 02:30:03.288285 20133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:03.291247 20229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:03.296950 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 20133
I20260809 02:30:03.297112 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:03.297360 20229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979: Bootstrap starting.
I20260809 02:30:03.297439 22362 external_mini_cluster.cc:1428] Setting key 4cddf240b549badbed68a2c65f1cf9af
I20260809 02:30:03.300124 20229 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:03.300921 20229 log.cc:824] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:03.303376 20229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979: No bootstrap required, opened a new log
I20260809 02:30:03.307802 20233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:03.298914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45073 (local address 127.0.0.1:41223)
0809 02:30:03.299453 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:03.299471 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:03.299512 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:30:03.300344 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:03.300365 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:03.300758 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:03.301134 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:03.301652 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:03.302930 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:03.304205 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:03.304729 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:03.304876 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:03.305841 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:03.305846 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:03.305860 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:03.306291 (+ 431us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:03.306352 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:03.306377 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:03.306562 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:03.306752 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 02:30:03.307012 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":160,"threads_started":1}
I20260809 02:30:03.307734 20229 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45cc5a192c044b409979201fc0e13979" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41223 } }
I20260809 02:30:03.307976 20229 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:03.308051 20229 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45cc5a192c044b409979201fc0e13979, State: Initialized, Role: FOLLOWER
I20260809 02:30:03.308509 20229 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45cc5a192c044b409979201fc0e13979" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41223 } }
I20260809 02:30:03.308634 20229 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:03.308676 20229 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:03.308743 20229 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:03.309917 20229 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45cc5a192c044b409979201fc0e13979" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41223 } }
I20260809 02:30:03.310257 20229 leader_election.cc:302] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45cc5a192c044b409979201fc0e13979; no voters:
I20260809 02:30:03.310616 20229 leader_election.cc:288] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:03.310717 20235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:03.310961 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:03.310958 20235 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [term 1 LEADER]: Becoming Leader. State: Replica: 45cc5a192c044b409979201fc0e13979, State: Running, Role: LEADER
I20260809 02:30:03.311299 20235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45cc5a192c044b409979201fc0e13979" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41223 } }
I20260809 02:30:03.311978 20229 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:03.312978 20240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45cc5a192c044b409979201fc0e13979. Latest consensus state: current_term: 1 leader_uuid: "45cc5a192c044b409979201fc0e13979" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45cc5a192c044b409979201fc0e13979" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41223 } } }
I20260809 02:30:03.313114 20240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:03.313498 20239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45cc5a192c044b409979201fc0e13979" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45cc5a192c044b409979201fc0e13979" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41223 } } }
I20260809 02:30:03.313598 20239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979 [sys.catalog]: This master's current role is: LEADER
W20260809 02:30:03.317539 20271 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:30:03.317619 20271 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:30:03.317679 20259 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:03.318603 20259 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:03.323403 20233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:03.313276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40321 (local address 127.0.0.1:41223)
0809 02:30:03.313412 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:03.313416 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:03.314856 (+ 1440us) server_negotiation.cc:407] Connection header received
0809 02:30:03.314972 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:03.314975 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:03.315029 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:03.315111 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:03.315398 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:03.316115 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:03.317399 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:03.317741 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:03.317847 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:03.322855 (+ 5008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:03.322860 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:03.322864 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:03.322879 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:03.322911 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:03.322925 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:03.323014 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:03.323162 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 02:30:03.323230 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 02:30:03.327778 20259 catalog_manager.cc:1347] Generated new cluster ID: 3cdc483a8e574fe5a1dcedbbdd20ea91
I20260809 02:30:03.327847 20259 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:03.342604 20259 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:03.343554 20259 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:03.352607 20259 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45cc5a192c044b409979201fc0e13979: Generated new TSK 0
I20260809 02:30:03.353335 20259 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:03.359846 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 20133
2026-08-09T02:30:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1636 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:03 dist-test-slave-68xk krb5kdc[20281](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:03 dist-test-slave-68xk krb5kdc[20281](info): set up 2 sockets
Aug 09 02:30:03 dist-test-slave-68xk krb5kdc[20281](info): commencing operation
krb5kdc: starting...
W20260809 02:30:04.654285 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:04 dist-test-slave-68xk krb5kdc[20281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242604, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:30:04.789377 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41835
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41835
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:04.904318 20305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:04.904613 20305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:04.904657 20305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:04.908775 20305 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:04.908840 20305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:04.908860 20305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:04.908876 20305 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:04.908921 20305 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:04.914222 20305 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:04.915341 20305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:04.916389 20305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:04.925101 20314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:04.925086 20311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:04.925180 20312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:04.925338 20305 server_base.cc:1034] running on GCE node
I20260809 02:30:04.925912 20305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:04.927058 20305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:04.928256 20305 hybrid_clock.cc:648] HybridClock initialized: now 1786242604928232 us; error 42 us; skew 500 ppm
Aug 09 02:30:04 dist-test-slave-68xk krb5kdc[20281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242604, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:04.931275 20305 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:30:04.932211 20305 webserver.cc:460] Webserver started at http://127.0.0.1:46059/ using document root <none> and password file <none>
I20260809 02:30:04.932793 20305 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:04.932889 20305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:04.933138 20305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:04.935272 20305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "3ce6bc4774ff478e95307c3b840282a1"
format_stamp: "Formatted at 2026-08-09 02:30:04 on dist-test-slave-68xk"
server_key: "2a42ae53a0f264f4cc3c6005c2284f9b"
server_key_iv: "28a7fdc4935aeca4e9c0359eec63b729"
server_key_version: "encryptionkey@0"
I20260809 02:30:04.935845 20305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "3ce6bc4774ff478e95307c3b840282a1"
format_stamp: "Formatted at 2026-08-09 02:30:04 on dist-test-slave-68xk"
server_key: "2a42ae53a0f264f4cc3c6005c2284f9b"
server_key_iv: "28a7fdc4935aeca4e9c0359eec63b729"
server_key_version: "encryptionkey@0"
I20260809 02:30:04.939682 20305 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 02:30:04.942240 20325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:04.943601 20305 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 02:30:04.943765 20305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "3ce6bc4774ff478e95307c3b840282a1"
format_stamp: "Formatted at 2026-08-09 02:30:04 on dist-test-slave-68xk"
server_key: "2a42ae53a0f264f4cc3c6005c2284f9b"
server_key_iv: "28a7fdc4935aeca4e9c0359eec63b729"
server_key_version: "encryptionkey@0"
I20260809 02:30:04.943883 20305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:04.948582 20305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:04.951943 20305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:04.952155 20305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:04.960052 20305 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41835
I20260809 02:30:04.960079 20397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41835 every 8 connection(s)
I20260809 02:30:04.961035 20305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:04.964030 20398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:04.966764 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 20305
I20260809 02:30:04.966924 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:04.967208 22362 external_mini_cluster.cc:1428] Setting key 006884798ad84edee6164a2fe80265b1
I20260809 02:30:04.970027 20398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1: Bootstrap starting.
I20260809 02:30:04.972358 20403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:04.968636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44135 (local address 127.0.0.1:41835)
0809 02:30:04.969089 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:04.969104 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:04.969143 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:30:04.969754 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:04.969773 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:04.970042 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:04.970403 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:04.971222 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:04.971226 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:04.971237 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:04.971248 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:04.971302 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:04.971320 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:04.971470 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:04.971542 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 02:30:04.971704 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":149,"threads_started":1}
I20260809 02:30:04.972642 20398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:04.973423 20398 log.cc:824] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:04.975339 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:04.975675 20398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1: No bootstrap required, opened a new log
I20260809 02:30:04.979514 20403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:04.977693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40589 (local address 127.0.0.1:41835)
0809 02:30:04.977820 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:04.977824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:04.978032 (+ 208us) server_negotiation.cc:407] Connection header received
0809 02:30:04.978167 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:04.978170 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:04.978207 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:04.978292 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:04.979130 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:04.979133 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:04.979136 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:04.979147 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:04.979173 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:04.979191 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:04.979285 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:04.979360 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 02:30:04.979398 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 02:30:04.979861 20398 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ce6bc4774ff478e95307c3b840282a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41835 } }
I20260809 02:30:04.980134 20398 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:04.980197 20398 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce6bc4774ff478e95307c3b840282a1, State: Initialized, Role: FOLLOWER
I20260809 02:30:04.980680 20398 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ce6bc4774ff478e95307c3b840282a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41835 } }
I20260809 02:30:04.980809 20398 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:04.980891 20398 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:04.981009 20398 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:04.981889 20398 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ce6bc4774ff478e95307c3b840282a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41835 } }
I20260809 02:30:04.982272 20398 leader_election.cc:302] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ce6bc4774ff478e95307c3b840282a1; no voters:
I20260809 02:30:04.982635 20398 leader_election.cc:288] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:04.982746 20412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:04.982988 20412 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [term 1 LEADER]: Becoming Leader. State: Replica: 3ce6bc4774ff478e95307c3b840282a1, State: Running, Role: LEADER
I20260809 02:30:04.983280 20412 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ce6bc4774ff478e95307c3b840282a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41835 } }
I20260809 02:30:04.983844 20398 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:04.984987 20415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ce6bc4774ff478e95307c3b840282a1. Latest consensus state: current_term: 1 leader_uuid: "3ce6bc4774ff478e95307c3b840282a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ce6bc4774ff478e95307c3b840282a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41835 } } }
I20260809 02:30:04.985152 20415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:04.985483 20413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ce6bc4774ff478e95307c3b840282a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ce6bc4774ff478e95307c3b840282a1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41835 } } }
I20260809 02:30:04.985596 20413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:04.985652 20426 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:04.988952 20426 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:04.993988 20426 catalog_manager.cc:1347] Generated new cluster ID: fe468e4429964f288a90ddbb31cd7a8d
I20260809 02:30:04.994055 20426 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:05.007292 20426 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:05.007637 20426 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:05.023530 20426 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ce6bc4774ff478e95307c3b840282a1: Generated new TSK 0
I20260809 02:30:05.024210 20426 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:05.029424 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 20305
2026-08-09T02:30:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1664 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:05 dist-test-slave-68xk krb5kdc[20444](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:05 dist-test-slave-68xk krb5kdc[20444](info): set up 2 sockets
Aug 09 02:30:05 dist-test-slave-68xk krb5kdc[20444](info): commencing operation
krb5kdc: starting...
W20260809 02:30:06.305785 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:06 dist-test-slave-68xk krb5kdc[20444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:30:06.442497 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41431
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:06.562353 20462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:06.562639 20462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:06.562682 20462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:06.566625 20462 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:06.566684 20462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:06.566704 20462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:06.566720 20462 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:06.566735 20462 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:06.571874 20462 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:06.572880 20462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:06.573848 20462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 02:30:06.582780 20462 server_base.cc:1034] running on GCE node
W20260809 02:30:06.582702 20472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:06.582742 20468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:06.582701 20467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:06.583536 20462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:06.584633 20462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:06.585827 20462 hybrid_clock.cc:648] HybridClock initialized: now 1786242606585774 us; error 67 us; skew 500 ppm
Aug 09 02:30:06 dist-test-slave-68xk krb5kdc[20444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242606, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:06.589030 20462 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:30:06.590040 20462 webserver.cc:460] Webserver started at http://127.0.0.1:37291/ using document root <none> and password file <none>
I20260809 02:30:06.590730 20462 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:06.590827 20462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:06.591084 20462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:06.593183 20462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "149e45eb7d20481589fa697535fc59dd"
format_stamp: "Formatted at 2026-08-09 02:30:06 on dist-test-slave-68xk"
server_key: "b14ca8ce95435b2b967e9a66dc4c0c13"
server_key_iv: "5283318f3601f968c90ae8331193eae5"
server_key_version: "encryptionkey@0"
I20260809 02:30:06.593783 20462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "149e45eb7d20481589fa697535fc59dd"
format_stamp: "Formatted at 2026-08-09 02:30:06 on dist-test-slave-68xk"
server_key: "b14ca8ce95435b2b967e9a66dc4c0c13"
server_key_iv: "5283318f3601f968c90ae8331193eae5"
server_key_version: "encryptionkey@0"
I20260809 02:30:06.597906 20462 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.005s
I20260809 02:30:06.600682 20483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:06.602037 20462 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:30:06.602239 20462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "149e45eb7d20481589fa697535fc59dd"
format_stamp: "Formatted at 2026-08-09 02:30:06 on dist-test-slave-68xk"
server_key: "b14ca8ce95435b2b967e9a66dc4c0c13"
server_key_iv: "5283318f3601f968c90ae8331193eae5"
server_key_version: "encryptionkey@0"
I20260809 02:30:06.602368 20462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:06.639243 20462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:06.642769 20462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:06.643003 20462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:06.651190 20462 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41431
I20260809 02:30:06.651211 20557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41431 every 8 connection(s)
I20260809 02:30:06.652263 20462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:06.655112 20559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:06.660502 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 20462
I20260809 02:30:06.660669 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:06.660802 20559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd: Bootstrap starting.
I20260809 02:30:06.660979 22362 external_mini_cluster.cc:1428] Setting key 9b6682e4bf697101bc54b04cf6662639
I20260809 02:30:06.663475 20559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:06.664233 20559 log.cc:824] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:06.666141 20559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd: No bootstrap required, opened a new log
I20260809 02:30:06.669742 20559 raft_consensus.cc:348] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149e45eb7d20481589fa697535fc59dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } }
I20260809 02:30:06.669953 20559 raft_consensus.cc:374] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:06.670019 20559 raft_consensus.cc:729] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 149e45eb7d20481589fa697535fc59dd, State: Initialized, Role: FOLLOWER
I20260809 02:30:06.670549 20559 consensus_queue.cc:260] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149e45eb7d20481589fa697535fc59dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } }
I20260809 02:30:06.670704 20559 raft_consensus.cc:388] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:06.670796 20559 raft_consensus.cc:482] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:06.670897 20559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [term 0 FOLLOWER]: Advancing to term 1
Aug 09 02:30:06 dist-test-slave-68xk krb5kdc[20444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:30:06.672062 20559 raft_consensus.cc:504] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149e45eb7d20481589fa697535fc59dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } }
I20260809 02:30:06.672423 20559 leader_election.cc:302] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 149e45eb7d20481589fa697535fc59dd; no voters:
I20260809 02:30:06.672755 20559 leader_election.cc:288] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:06.672876 20567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:06.673153 20567 raft_consensus.cc:686] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [term 1 LEADER]: Becoming Leader. State: Replica: 149e45eb7d20481589fa697535fc59dd, State: Running, Role: LEADER
I20260809 02:30:06.673564 20567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149e45eb7d20481589fa697535fc59dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } }
I20260809 02:30:06.674027 20559 sys_catalog.cc:564] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:06.675444 20568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "149e45eb7d20481589fa697535fc59dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149e45eb7d20481589fa697535fc59dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } } }
I20260809 02:30:06.675607 20568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:06.676061 20570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 149e45eb7d20481589fa697535fc59dd. Latest consensus state: current_term: 1 leader_uuid: "149e45eb7d20481589fa697535fc59dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149e45eb7d20481589fa697535fc59dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } } }
I20260809 02:30:06.676172 20570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:06.676964 20583 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:06.678509 20563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:06.662472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:57315 (local address 127.0.0.1:41431)
0809 02:30:06.662952 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:06.662969 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:06.663022 (+ 53us) server_negotiation.cc:407] Connection header received
0809 02:30:06.663847 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:06.663868 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:06.664253 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:06.664689 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:06.665607 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:06.666876 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:06.667855 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:06.668390 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:06.668594 (+ 204us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:06.671707 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:06.671712 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:06.671725 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:06.671752 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:06.674022 (+ 2270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:06.674824 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:06.674830 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:06.674837 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:06.674998 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:06.675601 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:06.675604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:06.675606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:06.676253 (+ 647us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:06.677205 (+ 952us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:06.677369 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 02:30:06.677556 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":129,"threads_started":1}
I20260809 02:30:06.679979 20583 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:06.682228 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:06.686400 20583 catalog_manager.cc:1347] Generated new cluster ID: e34ee633adaa49ad9dc8c3601e8e451e
I20260809 02:30:06.686507 20583 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:06.694113 20563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:06.684558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:39219 (local address 127.0.0.1:41431)
0809 02:30:06.684676 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:06.684680 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:06.686387 (+ 1707us) server_negotiation.cc:407] Connection header received
0809 02:30:06.686569 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:06.686575 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:06.686634 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:06.686717 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:06.687390 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:06.688037 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:06.688874 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:06.689121 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:06.689277 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:06.690714 (+ 1437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:06.690718 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:06.690720 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:06.690751 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:06.692196 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:06.692691 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:06.692701 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:06.692703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:06.692778 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:06.693114 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:06.693118 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:06.693119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:06.693299 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:06.693471 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:06.693740 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 02:30:06.693838 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 02:30:06.699836 20583 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:06.701145 20583 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:06.708515 20583 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 149e45eb7d20481589fa697535fc59dd: Generated new TSK 0
I20260809 02:30:06.709357 20583 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:06.721128 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 20462
W20260809 02:30:06.733460 20442 connection.cc:535] client connection to 127.0.0.1:41431 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41431): Connection reset by peer (error 104)
2026-08-09T02:30:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1693 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:06 dist-test-slave-68xk krb5kdc[20606](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:06 dist-test-slave-68xk krb5kdc[20606](info): set up 2 sockets
Aug 09 02:30:06 dist-test-slave-68xk krb5kdc[20606](info): commencing operation
krb5kdc: starting...
W20260809 02:30:07.958930 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.211s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:08 dist-test-slave-68xk krb5kdc[20606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:30:08.091212 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34963
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:08.203080 20632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:08.203382 20632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:08.203469 20632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:08.207547 20632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:08.207645 20632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:08.207683 20632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:08.207742 20632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:08.207783 20632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:08.213063 20632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:08.214174 20632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:08.215307 20632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:08.224232 20642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:08.224293 20640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:08.224255 20639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:08.224500 20632 server_base.cc:1034] running on GCE node
I20260809 02:30:08.225206 20632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:08.226388 20632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:08.227656 20632 hybrid_clock.cc:648] HybridClock initialized: now 1786242608227637 us; error 31 us; skew 500 ppm
Aug 09 02:30:08 dist-test-slave-68xk krb5kdc[20606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242608, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:08.230643 20632 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:30:08.231889 20632 webserver.cc:460] Webserver started at http://127.0.0.1:40553/ using document root <none> and password file <none>
I20260809 02:30:08.232697 20632 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:08.232801 20632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:08.233125 20632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:08.235707 20632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "737823fb0ff14ab7a4ac941066fad92e"
format_stamp: "Formatted at 2026-08-09 02:30:08 on dist-test-slave-68xk"
server_key: "ac71976cb9b61d4bdb9ac52f46f9bd29"
server_key_iv: "ed04d8efec2a658be881e89296f81c86"
server_key_version: "encryptionkey@0"
I20260809 02:30:08.236256 20632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "737823fb0ff14ab7a4ac941066fad92e"
format_stamp: "Formatted at 2026-08-09 02:30:08 on dist-test-slave-68xk"
server_key: "ac71976cb9b61d4bdb9ac52f46f9bd29"
server_key_iv: "ed04d8efec2a658be881e89296f81c86"
server_key_version: "encryptionkey@0"
I20260809 02:30:08.240257 20632 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:30:08.242892 20649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:08.244333 20632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:30:08.244500 20632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "737823fb0ff14ab7a4ac941066fad92e"
format_stamp: "Formatted at 2026-08-09 02:30:08 on dist-test-slave-68xk"
server_key: "ac71976cb9b61d4bdb9ac52f46f9bd29"
server_key_iv: "ed04d8efec2a658be881e89296f81c86"
server_key_version: "encryptionkey@0"
I20260809 02:30:08.244616 20632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:08.268814 20632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:08.272861 20632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:08.273092 20632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:08.281102 20632 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34963
I20260809 02:30:08.281190 20727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34963 every 8 connection(s)
I20260809 02:30:08.282224 20632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:08.285189 20728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:08.288223 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 20632
I20260809 02:30:08.288403 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:08.288733 22362 external_mini_cluster.cc:1428] Setting key 865bbd46939c3761f1b0ef056cd39703
I20260809 02:30:08.291400 20728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e: Bootstrap starting.
I20260809 02:30:08.293839 20728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:08.294862 20728 log.cc:824] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:08.297255 20728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e: No bootstrap required, opened a new log
I20260809 02:30:08.299436 20732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:08.290325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:60081 (local address 127.0.0.1:34963)
0809 02:30:08.290853 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:08.290871 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:08.290910 (+ 39us) server_negotiation.cc:407] Connection header received
0809 02:30:08.291656 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:08.291676 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:08.292052 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:08.292416 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:08.292809 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:08.293904 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:08.295252 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:08.296057 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:08.296209 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:08.297180 (+ 971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:08.297186 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:08.297198 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:08.297686 (+ 488us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:08.297745 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:08.297769 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:08.297879 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:08.298095 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 02:30:08.298304 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":156,"threads_started":1}
I20260809 02:30:08.300686 20728 raft_consensus.cc:348] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "737823fb0ff14ab7a4ac941066fad92e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34963 } }
I20260809 02:30:08.300949 20728 raft_consensus.cc:374] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:08.300998 20728 raft_consensus.cc:729] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 737823fb0ff14ab7a4ac941066fad92e, State: Initialized, Role: FOLLOWER
I20260809 02:30:08.301419 20728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "737823fb0ff14ab7a4ac941066fad92e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34963 } }
I20260809 02:30:08.301594 20728 raft_consensus.cc:388] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:08.301666 20728 raft_consensus.cc:482] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:08.301770 20728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:08.302656 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:08.302970 20728 raft_consensus.cc:504] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "737823fb0ff14ab7a4ac941066fad92e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34963 } }
I20260809 02:30:08.303313 20728 leader_election.cc:302] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 737823fb0ff14ab7a4ac941066fad92e; no voters:
I20260809 02:30:08.303658 20728 leader_election.cc:288] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:08.303726 20736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:08.303937 20736 raft_consensus.cc:686] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [term 1 LEADER]: Becoming Leader. State: Replica: 737823fb0ff14ab7a4ac941066fad92e, State: Running, Role: LEADER
I20260809 02:30:08.304247 20736 consensus_queue.cc:237] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "737823fb0ff14ab7a4ac941066fad92e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34963 } }
I20260809 02:30:08.304963 20728 sys_catalog.cc:564] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:08.306147 20738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 737823fb0ff14ab7a4ac941066fad92e. Latest consensus state: current_term: 1 leader_uuid: "737823fb0ff14ab7a4ac941066fad92e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "737823fb0ff14ab7a4ac941066fad92e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34963 } } }
I20260809 02:30:08.306185 20737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "737823fb0ff14ab7a4ac941066fad92e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "737823fb0ff14ab7a4ac941066fad92e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34963 } } }
I20260809 02:30:08.306384 20737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:08.306500 20738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:08.306860 20754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:08.310169 20754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:08.311720 20732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:08.305283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:47443 (local address 127.0.0.1:34963)
0809 02:30:08.305389 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:08.305395 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:08.305943 (+ 548us) server_negotiation.cc:407] Connection header received
0809 02:30:08.306186 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:08.306190 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:08.306244 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:08.306307 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:08.306806 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:08.307597 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:08.309395 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:08.309808 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:08.309917 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:08.311097 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:08.311103 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:08.311118 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:08.311136 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:08.311171 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:08.311188 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:08.311286 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:08.311507 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 02:30:08.311547 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 02:30:08.316557 20754 catalog_manager.cc:1347] Generated new cluster ID: 36d1954307954048b5be6149b85a0d0f
I20260809 02:30:08.316627 20754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:08.345897 20754 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:08.346975 20754 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:08.354305 20754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 737823fb0ff14ab7a4ac941066fad92e: Generated new TSK 0
I20260809 02:30:08.355476 20754 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:08.373663 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 20632
W20260809 02:30:08.385939 20604 connection.cc:535] client connection to 127.0.0.1:34963 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34963): Connection reset by peer (error 104)
2026-08-09T02:30:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1652 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:08 dist-test-slave-68xk krb5kdc[20771](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:08 dist-test-slave-68xk krb5kdc[20771](info): set up 2 sockets
Aug 09 02:30:08 dist-test-slave-68xk krb5kdc[20771](info): commencing operation
krb5kdc: starting...
W20260809 02:30:09.636870 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:09 dist-test-slave-68xk krb5kdc[20771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242609, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:30:09.774174 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43299
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43299
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:09.891005 20785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:09.891323 20785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:09.891398 20785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:09.895394 20785 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:09.895489 20785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:09.895530 20785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:09.895591 20785 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:09.895617 20785 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:09.900992 20785 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43299
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:09.902120 20785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:09.903301 20785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:09.912366 20793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:09.912387 20792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:09.912389 20796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:09.912532 20785 server_base.cc:1034] running on GCE node
I20260809 02:30:09.913234 20785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:09.914464 20785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:09.915656 20785 hybrid_clock.cc:648] HybridClock initialized: now 1786242609915637 us; error 31 us; skew 500 ppm
Aug 09 02:30:09 dist-test-slave-68xk krb5kdc[20771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242609, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:09.918493 20785 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:30:09.919422 20785 webserver.cc:460] Webserver started at http://127.0.0.1:39923/ using document root <none> and password file <none>
I20260809 02:30:09.920023 20785 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:09.920136 20785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:09.920384 20785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:09.922503 20785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "5d8d5416b89d4ab291a4a9352c0029bb"
format_stamp: "Formatted at 2026-08-09 02:30:09 on dist-test-slave-68xk"
server_key: "161b726642c5a4469584d663a9026162"
server_key_iv: "f1338d28ed79809ef8831c424c7533d2"
server_key_version: "encryptionkey@0"
I20260809 02:30:09.923069 20785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "5d8d5416b89d4ab291a4a9352c0029bb"
format_stamp: "Formatted at 2026-08-09 02:30:09 on dist-test-slave-68xk"
server_key: "161b726642c5a4469584d663a9026162"
server_key_iv: "f1338d28ed79809ef8831c424c7533d2"
server_key_version: "encryptionkey@0"
I20260809 02:30:09.926852 20785 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 02:30:09.929291 20809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:09.930637 20785 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 02:30:09.930781 20785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "5d8d5416b89d4ab291a4a9352c0029bb"
format_stamp: "Formatted at 2026-08-09 02:30:09 on dist-test-slave-68xk"
server_key: "161b726642c5a4469584d663a9026162"
server_key_iv: "f1338d28ed79809ef8831c424c7533d2"
server_key_version: "encryptionkey@0"
I20260809 02:30:09.930892 20785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:09.935478 20785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:09.938380 20785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:09.938661 20785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:09.945875 20785 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43299
I20260809 02:30:09.945891 20884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43299 every 8 connection(s)
I20260809 02:30:09.946841 20785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:09.949589 20886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:09.951462 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 20785
I20260809 02:30:09.951613 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:09.951915 22362 external_mini_cluster.cc:1428] Setting key 3c31584c68ef8e6cbfaefc4983284b48
I20260809 02:30:09.956663 20886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb: Bootstrap starting.
I20260809 02:30:09.957830 20889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:09.953458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:50065 (local address 127.0.0.1:43299)
0809 02:30:09.953956 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:09.953973 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:09.954013 (+ 40us) server_negotiation.cc:407] Connection header received
0809 02:30:09.954879 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:09.954900 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:09.955217 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:09.955605 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:09.956514 (+ 909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:09.956518 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:09.956532 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:09.956544 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:09.956610 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:09.956631 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:09.956826 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:09.956906 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 02:30:09.957089 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":155,"threads_started":1}
I20260809 02:30:09.959299 20886 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:09.960175 20886 log.cc:824] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:09.961084 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:09.962414 20886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb: No bootstrap required, opened a new log
I20260809 02:30:09.965322 20889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:09.963484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:51847 (local address 127.0.0.1:43299)
0809 02:30:09.963597 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:09.963600 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:09.963846 (+ 246us) server_negotiation.cc:407] Connection header received
0809 02:30:09.963963 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:09.963965 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:09.963993 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:09.964063 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:09.964777 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:09.964780 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:09.964782 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:09.964792 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:09.964816 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:09.964826 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:09.964896 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:09.965066 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 02:30:09.965168 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:30:09.967044 20886 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d8d5416b89d4ab291a4a9352c0029bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43299 } }
I20260809 02:30:09.967293 20886 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:09.967352 20886 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d8d5416b89d4ab291a4a9352c0029bb, State: Initialized, Role: FOLLOWER
I20260809 02:30:09.967828 20886 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d8d5416b89d4ab291a4a9352c0029bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43299 } }
I20260809 02:30:09.967985 20886 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:09.968052 20886 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:09.968151 20886 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:09.969059 20886 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d8d5416b89d4ab291a4a9352c0029bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43299 } }
I20260809 02:30:09.969408 20886 leader_election.cc:302] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d8d5416b89d4ab291a4a9352c0029bb; no voters:
I20260809 02:30:09.969725 20886 leader_election.cc:288] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:09.969862 20898 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:09.970110 20898 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [term 1 LEADER]: Becoming Leader. State: Replica: 5d8d5416b89d4ab291a4a9352c0029bb, State: Running, Role: LEADER
I20260809 02:30:09.970567 20898 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d8d5416b89d4ab291a4a9352c0029bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43299 } }
I20260809 02:30:09.971060 20886 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:09.972401 20899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d8d5416b89d4ab291a4a9352c0029bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d8d5416b89d4ab291a4a9352c0029bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43299 } } }
I20260809 02:30:09.972534 20899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:09.972924 20900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d8d5416b89d4ab291a4a9352c0029bb. Latest consensus state: current_term: 1 leader_uuid: "5d8d5416b89d4ab291a4a9352c0029bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d8d5416b89d4ab291a4a9352c0029bb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43299 } } }
I20260809 02:30:09.972977 20916 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:09.973079 20900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:09.976276 20916 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:09.982103 20916 catalog_manager.cc:1347] Generated new cluster ID: d58a430097454f6fb9d65d25ea04712b
I20260809 02:30:09.982188 20916 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:10.007659 20916 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:10.008035 20916 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:10.024747 20916 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d8d5416b89d4ab291a4a9352c0029bb: Generated new TSK 0
I20260809 02:30:10.025528 20916 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:10.035127 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 20785
2026-08-09T02:30:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1664 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:10 dist-test-slave-68xk krb5kdc[20934](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:10 dist-test-slave-68xk krb5kdc[20934](info): set up 2 sockets
Aug 09 02:30:10 dist-test-slave-68xk krb5kdc[20934](info): commencing operation
krb5kdc: starting...
W20260809 02:30:11.270301 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:11 dist-test-slave-68xk krb5kdc[20934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242611, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:30:11.402141 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34253
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34253
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:11.517629 20957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:11.517907 20957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:11.517951 20957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:11.521883 20957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:11.521945 20957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:11.521965 20957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:11.521981 20957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:11.521996 20957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:11.527724 20957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34253
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:11.528753 20957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:11.529700 20957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:11.538674 20963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:11.538630 20964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:11.538674 20966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:11.539017 20957 server_base.cc:1034] running on GCE node
I20260809 02:30:11.539685 20957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:11.540844 20957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:11.542037 20957 hybrid_clock.cc:648] HybridClock initialized: now 1786242611542006 us; error 57 us; skew 500 ppm
Aug 09 02:30:11 dist-test-slave-68xk krb5kdc[20934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242611, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:11.544996 20957 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:30:11.545948 20957 webserver.cc:460] Webserver started at http://127.0.0.1:37407/ using document root <none> and password file <none>
I20260809 02:30:11.546586 20957 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:11.546684 20957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:11.546919 20957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:11.548992 20957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "0e912f1e83dd4c1394e8ce0c39e7da38"
format_stamp: "Formatted at 2026-08-09 02:30:11 on dist-test-slave-68xk"
server_key: "c5c0a4d8db8cfc68761d3f4d4d26f0b7"
server_key_iv: "b81b253e88dfc74669feba34c5cfd17e"
server_key_version: "encryptionkey@0"
I20260809 02:30:11.549576 20957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "0e912f1e83dd4c1394e8ce0c39e7da38"
format_stamp: "Formatted at 2026-08-09 02:30:11 on dist-test-slave-68xk"
server_key: "c5c0a4d8db8cfc68761d3f4d4d26f0b7"
server_key_iv: "b81b253e88dfc74669feba34c5cfd17e"
server_key_version: "encryptionkey@0"
I20260809 02:30:11.553570 20957 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 02:30:11.556133 20976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:11.557401 20957 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:30:11.557548 20957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "0e912f1e83dd4c1394e8ce0c39e7da38"
format_stamp: "Formatted at 2026-08-09 02:30:11 on dist-test-slave-68xk"
server_key: "c5c0a4d8db8cfc68761d3f4d4d26f0b7"
server_key_iv: "b81b253e88dfc74669feba34c5cfd17e"
server_key_version: "encryptionkey@0"
I20260809 02:30:11.557659 20957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:11.571592 20957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:11.574908 20957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:11.575116 20957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:11.582615 20957 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34253
I20260809 02:30:11.582633 21045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34253 every 8 connection(s)
I20260809 02:30:11.583611 20957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:11.586480 21047 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:11.589229 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 20957
I20260809 02:30:11.589375 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:11.589722 22362 external_mini_cluster.cc:1428] Setting key efea8ef2f1a6d6425c371567670cda9d
I20260809 02:30:11.592854 21047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38: Bootstrap starting.
I20260809 02:30:11.595214 21047 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:11.596015 21047 log.cc:824] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:11.598743 21047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38: No bootstrap required, opened a new log
Aug 09 02:30:11 dist-test-slave-68xk krb5kdc[20934](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242611, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 02:30:11.603592 21047 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e912f1e83dd4c1394e8ce0c39e7da38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34253 } }
I20260809 02:30:11.603880 21047 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:11.604001 21047 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e912f1e83dd4c1394e8ce0c39e7da38, State: Initialized, Role: FOLLOWER
I20260809 02:30:11.604503 21047 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e912f1e83dd4c1394e8ce0c39e7da38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34253 } }
I20260809 02:30:11.604687 21047 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:11.604753 21047 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:11.604851 21047 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:11.605274 21056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:11.591180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:60253 (local address 127.0.0.1:34253)
0809 02:30:11.591636 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:11.591651 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:11.591687 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:30:11.592316 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:11.592332 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:11.592665 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:11.593008 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:11.593822 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:11.594933 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:11.595863 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:11.596413 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:11.596595 (+ 182us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:11.599763 (+ 3168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:11.599770 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:11.599786 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:11.599817 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:11.601939 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:11.602482 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:11.602489 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:11.602495 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:11.602644 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:11.602991 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:11.602995 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:11.602996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:11.603505 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:11.603739 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:11.603972 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 02:30:11.604223 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":140,"threads_started":1}
I20260809 02:30:11.606021 21047 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e912f1e83dd4c1394e8ce0c39e7da38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34253 } }
I20260809 02:30:11.606369 21047 leader_election.cc:302] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e912f1e83dd4c1394e8ce0c39e7da38; no voters:
I20260809 02:30:11.606740 21047 leader_election.cc:288] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:11.606849 21059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:11.607074 21059 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [term 1 LEADER]: Becoming Leader. State: Replica: 0e912f1e83dd4c1394e8ce0c39e7da38, State: Running, Role: LEADER
I20260809 02:30:11.607471 21059 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e912f1e83dd4c1394e8ce0c39e7da38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34253 } }
I20260809 02:30:11.608937 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:11.609272 21047 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:11.609321 21063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e912f1e83dd4c1394e8ce0c39e7da38. Latest consensus state: current_term: 1 leader_uuid: "0e912f1e83dd4c1394e8ce0c39e7da38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e912f1e83dd4c1394e8ce0c39e7da38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34253 } } }
I20260809 02:30:11.609493 21063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:11.609891 21065 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:11.611104 21061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e912f1e83dd4c1394e8ce0c39e7da38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e912f1e83dd4c1394e8ce0c39e7da38" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34253 } } }
I20260809 02:30:11.611284 21061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:11.612998 21065 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:11.618640 21065 catalog_manager.cc:1347] Generated new cluster ID: 5945c1e8e7694deebab087f735fbea57
I20260809 02:30:11.618698 21065 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:11.624308 21056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:11.612045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:56809 (local address 127.0.0.1:34253)
0809 02:30:11.612150 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:11.612155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:11.615124 (+ 2969us) server_negotiation.cc:407] Connection header received
0809 02:30:11.615243 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:11.615246 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:11.615302 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:11.615395 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:11.616201 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:11.617028 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:11.618331 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:11.618770 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:11.618849 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:11.620718 (+ 1869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:11.620722 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:11.620725 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:11.620751 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:11.622444 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:11.622967 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:11.622971 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:11.622973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:11.623050 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:11.623383 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:11.623386 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:11.623388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:11.623566 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:11.623693 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:11.624060 (+ 367us) server_negotiation.cc:299] Negotiation successful
0809 02:30:11.624150 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 02:30:11.644719 21065 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:11.645990 21065 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:11.653873 21065 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e912f1e83dd4c1394e8ce0c39e7da38: Generated new TSK 0
I20260809 02:30:11.654673 21065 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:11.659027 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 20957
W20260809 02:30:11.674077 20930 connection.cc:535] client connection to 127.0.0.1:34253 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34253): Connection reset by peer (error 104)
2026-08-09T02:30:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1623 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:11 dist-test-slave-68xk krb5kdc[21098](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:11 dist-test-slave-68xk krb5kdc[21098](info): set up 2 sockets
Aug 09 02:30:11 dist-test-slave-68xk krb5kdc[21098](info): commencing operation
krb5kdc: starting...
W20260809 02:30:13.013044 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:13 dist-test-slave-68xk krb5kdc[21098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:30:13.146816 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34275
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:13.261155 21116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:13.261447 21116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:13.261530 21116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:13.265576 21116 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:13.265662 21116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:13.265699 21116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:13.265761 21116 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:13.265799 21116 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:13.271330 21116 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34275
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:13.272747 21116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:13.273809 21116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:13.282642 21128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:13.282652 21126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:13.282914 21116 server_base.cc:1034] running on GCE node
W20260809 02:30:13.282652 21122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:13.283631 21116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:13.284858 21116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:13.286056 21116 hybrid_clock.cc:648] HybridClock initialized: now 1786242613286032 us; error 38 us; skew 500 ppm
Aug 09 02:30:13 dist-test-slave-68xk krb5kdc[21098](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242613, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:13.288975 21116 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:30:13.289923 21116 webserver.cc:460] Webserver started at http://127.0.0.1:37153/ using document root <none> and password file <none>
I20260809 02:30:13.290580 21116 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:13.290652 21116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:13.290908 21116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:13.293053 21116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "a66f8024ec2a493ba34be669efb74054"
format_stamp: "Formatted at 2026-08-09 02:30:13 on dist-test-slave-68xk"
server_key: "e2405b3284ee0dd71fc1ab15afeb9ed3"
server_key_iv: "d7146420f1b5eca84cb9ddafbc7403fc"
server_key_version: "encryptionkey@0"
I20260809 02:30:13.293646 21116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "a66f8024ec2a493ba34be669efb74054"
format_stamp: "Formatted at 2026-08-09 02:30:13 on dist-test-slave-68xk"
server_key: "e2405b3284ee0dd71fc1ab15afeb9ed3"
server_key_iv: "d7146420f1b5eca84cb9ddafbc7403fc"
server_key_version: "encryptionkey@0"
I20260809 02:30:13.297567 21116 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 02:30:13.300144 21138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:13.301445 21116 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:30:13.301594 21116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "a66f8024ec2a493ba34be669efb74054"
format_stamp: "Formatted at 2026-08-09 02:30:13 on dist-test-slave-68xk"
server_key: "e2405b3284ee0dd71fc1ab15afeb9ed3"
server_key_iv: "d7146420f1b5eca84cb9ddafbc7403fc"
server_key_version: "encryptionkey@0"
I20260809 02:30:13.301708 21116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:13.313010 21116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:13.316108 21116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:13.316334 21116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:13.323828 21116 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34275
I20260809 02:30:13.323845 21221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34275 every 8 connection(s)
I20260809 02:30:13.324827 21116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:13.327836 21222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:13.333678 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 21116
I20260809 02:30:13.333841 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:13.334110 21222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054: Bootstrap starting.
I20260809 02:30:13.334203 22362 external_mini_cluster.cc:1428] Setting key c86a7118aec427fd35eb813f85c1b4f9
I20260809 02:30:13.336946 21222 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:13.337906 21222 log.cc:824] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:13.340220 21222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054: No bootstrap required, opened a new log
I20260809 02:30:13.343436 21225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:13.335574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:48149 (local address 127.0.0.1:34275)
0809 02:30:13.335989 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:13.336005 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:13.336040 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:30:13.336657 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:13.336673 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:13.337027 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:13.337344 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:13.337668 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:13.338902 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:13.340168 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:13.340680 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:13.340804 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:13.341711 (+ 907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:13.341715 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:13.341727 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:13.342098 (+ 371us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:13.342148 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:13.342169 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:13.342276 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:13.342572 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 02:30:13.342713 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":145,"threads_started":1}
I20260809 02:30:13.344305 21222 raft_consensus.cc:348] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f8024ec2a493ba34be669efb74054" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34275 } }
I20260809 02:30:13.344599 21222 raft_consensus.cc:374] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:13.344659 21222 raft_consensus.cc:729] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a66f8024ec2a493ba34be669efb74054, State: Initialized, Role: FOLLOWER
I20260809 02:30:13.345116 21222 consensus_queue.cc:260] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f8024ec2a493ba34be669efb74054" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34275 } }
I20260809 02:30:13.345280 21222 raft_consensus.cc:388] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:13.345369 21222 raft_consensus.cc:482] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:13.345490 21222 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:13.346509 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:13.346601 21222 raft_consensus.cc:504] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f8024ec2a493ba34be669efb74054" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34275 } }
I20260809 02:30:13.346935 21222 leader_election.cc:302] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a66f8024ec2a493ba34be669efb74054; no voters:
I20260809 02:30:13.347272 21222 leader_election.cc:288] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:13.347425 21228 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:13.347728 21228 raft_consensus.cc:686] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [term 1 LEADER]: Becoming Leader. State: Replica: a66f8024ec2a493ba34be669efb74054, State: Running, Role: LEADER
I20260809 02:30:13.348053 21228 consensus_queue.cc:237] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f8024ec2a493ba34be669efb74054" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34275 } }
I20260809 02:30:13.348613 21222 sys_catalog.cc:564] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:13.349361 21229 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a66f8024ec2a493ba34be669efb74054. Latest consensus state: current_term: 1 leader_uuid: "a66f8024ec2a493ba34be669efb74054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f8024ec2a493ba34be669efb74054" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34275 } } }
I20260809 02:30:13.349506 21229 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:13.349949 21231 sys_catalog.cc:455] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a66f8024ec2a493ba34be669efb74054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a66f8024ec2a493ba34be669efb74054" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34275 } } }
I20260809 02:30:13.350126 21231 sys_catalog.cc:458] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:13.350909 21251 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:13.354040 21225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:13.348840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:49947 (local address 127.0.0.1:34275)
0809 02:30:13.348954 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:13.348958 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:13.349851 (+ 893us) server_negotiation.cc:407] Connection header received
0809 02:30:13.350119 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:13.350122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:13.350165 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:13.350216 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:13.350676 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:13.351416 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:13.352342 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:13.352557 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:13.352680 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:13.353579 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:13.353583 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:13.353585 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:13.353598 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:13.353631 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:13.353641 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:13.353743 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:13.353867 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 02:30:13.353899 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 02:30:13.354830 21251 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:13.360445 21251 catalog_manager.cc:1347] Generated new cluster ID: 6d955aefed304cf186ff43940ae35c34
I20260809 02:30:13.360507 21251 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:13.373390 21251 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:13.374579 21251 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:13.395605 21251 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a66f8024ec2a493ba34be669efb74054: Generated new TSK 0
I20260809 02:30:13.396353 21251 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:13.407935 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 21116
W20260809 02:30:13.423465 21096 connection.cc:535] client connection to 127.0.0.1:34275 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34275): Connection reset by peer (error 104)
2026-08-09T02:30:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1749 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:13 dist-test-slave-68xk krb5kdc[21266](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:13 dist-test-slave-68xk krb5kdc[21266](info): set up 2 sockets
Aug 09 02:30:13 dist-test-slave-68xk krb5kdc[21266](info): commencing operation
krb5kdc: starting...
W20260809 02:30:14.640139 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:14 dist-test-slave-68xk krb5kdc[21266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242614, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 02:30:14.771462 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43711
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:14.885208 21287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:14.885461 21287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:14.885502 21287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:14.889568 21287 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:14.889628 21287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:14.889647 21287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:14.889663 21287 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:14.889678 21287 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:14.894940 21287 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43711
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:14.896003 21287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:14.897100 21287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:14.906049 21298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:14.906049 21295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:14.906149 21287 server_base.cc:1034] running on GCE node
W20260809 02:30:14.906072 21296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:14.906946 21287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:14.908059 21287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:14.909228 21287 hybrid_clock.cc:648] HybridClock initialized: now 1786242614909211 us; error 28 us; skew 500 ppm
Aug 09 02:30:14 dist-test-slave-68xk krb5kdc[21266](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242614, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:14.912217 21287 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 02:30:14.913091 21287 webserver.cc:460] Webserver started at http://127.0.0.1:46271/ using document root <none> and password file <none>
I20260809 02:30:14.913702 21287 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:14.913805 21287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:14.914038 21287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:14.916214 21287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "9009efbc118048ffbad5ff35ee882e32"
format_stamp: "Formatted at 2026-08-09 02:30:14 on dist-test-slave-68xk"
server_key: "39494766d6489b6aae0fdda4138330c7"
server_key_iv: "d17be9522db3f0f955791671dd02192a"
server_key_version: "encryptionkey@0"
I20260809 02:30:14.916795 21287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "9009efbc118048ffbad5ff35ee882e32"
format_stamp: "Formatted at 2026-08-09 02:30:14 on dist-test-slave-68xk"
server_key: "39494766d6489b6aae0fdda4138330c7"
server_key_iv: "d17be9522db3f0f955791671dd02192a"
server_key_version: "encryptionkey@0"
I20260809 02:30:14.920635 21287 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260809 02:30:14.923246 21313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:14.924511 21287 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:30:14.924671 21287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "9009efbc118048ffbad5ff35ee882e32"
format_stamp: "Formatted at 2026-08-09 02:30:14 on dist-test-slave-68xk"
server_key: "39494766d6489b6aae0fdda4138330c7"
server_key_iv: "d17be9522db3f0f955791671dd02192a"
server_key_version: "encryptionkey@0"
I20260809 02:30:14.924799 21287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:14.929479 21287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:14.932521 21287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:14.932732 21287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:14.940078 21287 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43711
I20260809 02:30:14.940092 21388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43711 every 8 connection(s)
I20260809 02:30:14.941023 21287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:14.943846 21391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:14.947958 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 21287
I20260809 02:30:14.948123 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:14.948408 22362 external_mini_cluster.cc:1428] Setting key 13636d4cfc62b1408425f78e39a91aed
I20260809 02:30:14.949605 21391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32: Bootstrap starting.
I20260809 02:30:14.952059 21391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:14.952836 21391 log.cc:824] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:14.953873 21394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:14.949828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:46585 (local address 127.0.0.1:43711)
0809 02:30:14.950292 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:14.950307 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:14.950344 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:30:14.951052 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:14.951068 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:14.951355 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:14.951694 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:14.952547 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:14.952552 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:14.952564 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:14.952574 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:14.952627 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:14.952646 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:14.952767 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:14.952899 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 02:30:14.953184 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":126,"threads_started":1}
I20260809 02:30:14.955122 21391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32: No bootstrap required, opened a new log
I20260809 02:30:14.956975 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:14.959172 21391 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9009efbc118048ffbad5ff35ee882e32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43711 } }
I20260809 02:30:14.959462 21391 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:14.959537 21391 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9009efbc118048ffbad5ff35ee882e32, State: Initialized, Role: FOLLOWER
I20260809 02:30:14.960047 21391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9009efbc118048ffbad5ff35ee882e32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43711 } }
I20260809 02:30:14.960227 21391 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:14.960347 21391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:14.960487 21391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:14.960937 21394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:14.959173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.210:60213 (local address 127.0.0.1:43711)
0809 02:30:14.959309 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:14.959314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:14.959440 (+ 126us) server_negotiation.cc:407] Connection header received
0809 02:30:14.959621 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:14.959628 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:14.959664 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:14.959759 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:14.960536 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:14.960539 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:14.960542 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:14.960564 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:14.960589 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:14.960599 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:14.960698 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:14.960775 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 02:30:14.960819 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 02:30:14.961673 21391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9009efbc118048ffbad5ff35ee882e32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43711 } }
I20260809 02:30:14.962049 21391 leader_election.cc:302] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9009efbc118048ffbad5ff35ee882e32; no voters:
I20260809 02:30:14.962363 21391 leader_election.cc:288] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:14.962517 21413 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:14.962770 21413 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [term 1 LEADER]: Becoming Leader. State: Replica: 9009efbc118048ffbad5ff35ee882e32, State: Running, Role: LEADER
I20260809 02:30:14.963212 21413 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9009efbc118048ffbad5ff35ee882e32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43711 } }
I20260809 02:30:14.963645 21391 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:14.964886 21415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9009efbc118048ffbad5ff35ee882e32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9009efbc118048ffbad5ff35ee882e32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43711 } } }
I20260809 02:30:14.965021 21415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:14.965430 21427 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:14.966117 21416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9009efbc118048ffbad5ff35ee882e32. Latest consensus state: current_term: 1 leader_uuid: "9009efbc118048ffbad5ff35ee882e32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9009efbc118048ffbad5ff35ee882e32" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43711 } } }
I20260809 02:30:14.966305 21416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:14.968367 21427 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:14.973601 21427 catalog_manager.cc:1347] Generated new cluster ID: 0a030d7a84744f0cb15308a0694f625f
I20260809 02:30:14.973666 21427 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:15.002586 21427 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:15.002942 21427 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:15.009826 21427 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9009efbc118048ffbad5ff35ee882e32: Generated new TSK 0
I20260809 02:30:15.010711 21427 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:15.018705 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 21287
2026-08-09T02:30:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1608 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:15 dist-test-slave-68xk krb5kdc[21444](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:15 dist-test-slave-68xk krb5kdc[21444](info): set up 2 sockets
Aug 09 02:30:15 dist-test-slave-68xk krb5kdc[21444](info): commencing operation
krb5kdc: starting...
W20260809 02:30:16.255848 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:16 dist-test-slave-68xk krb5kdc[21444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:30:16.394457 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:43275
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:41293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:43275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:16.509285 21460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:16.509582 21460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:16.509655 21460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:16.513638 21460 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:16.513734 21460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:16.513774 21460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:16.513813 21460 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:16.513846 21460 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:16.519223 21460 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:43275
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:43275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21460
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:16.520277 21460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:16.521365 21460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:16.530501 21470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:16.530562 21474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:16.530516 21471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:16.530800 21460 server_base.cc:1034] running on GCE node
I20260809 02:30:16.531513 21460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:16.532689 21460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:16.533906 21460 hybrid_clock.cc:648] HybridClock initialized: now 1786242616533889 us; error 39 us; skew 500 ppm
Aug 09 02:30:16 dist-test-slave-68xk krb5kdc[21444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242616, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:16.537071 21460 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:30:16.538089 21460 webserver.cc:460] Webserver started at http://127.21.214.190:43515/ using document root <none> and password file <none>
I20260809 02:30:16.538770 21460 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:16.538873 21460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:16.539127 21460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:16.541340 21460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "64b0bfde3a6b44c799fd4a08c1f9b52b"
format_stamp: "Formatted at 2026-08-09 02:30:16 on dist-test-slave-68xk"
server_key: "698cf096bc4b65494ae8bbbb786562f6"
server_key_iv: "1e8845bda83c46bce0c9e7b7eeeb8ec0"
server_key_version: "encryptionkey@0"
I20260809 02:30:16.541958 21460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "64b0bfde3a6b44c799fd4a08c1f9b52b"
format_stamp: "Formatted at 2026-08-09 02:30:16 on dist-test-slave-68xk"
server_key: "698cf096bc4b65494ae8bbbb786562f6"
server_key_iv: "1e8845bda83c46bce0c9e7b7eeeb8ec0"
server_key_version: "encryptionkey@0"
I20260809 02:30:16.546020 21460 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260809 02:30:16.548789 21484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:16.550573 21460 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:30:16.550720 21460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "64b0bfde3a6b44c799fd4a08c1f9b52b"
format_stamp: "Formatted at 2026-08-09 02:30:16 on dist-test-slave-68xk"
server_key: "698cf096bc4b65494ae8bbbb786562f6"
server_key_iv: "1e8845bda83c46bce0c9e7b7eeeb8ec0"
server_key_version: "encryptionkey@0"
I20260809 02:30:16.550851 21460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:16.584292 21460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:16.588137 21460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:16.588392 21460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:16.596808 21460 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:43275
I20260809 02:30:16.596840 21563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:43275 every 8 connection(s)
I20260809 02:30:16.597910 21460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:16.601022 21564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:16.601817 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 21460
I20260809 02:30:16.601985 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:16.602296 22362 external_mini_cluster.cc:1428] Setting key 43a6dabc96614f6360c29191524f48dc
I20260809 02:30:16.608465 21564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b: Bootstrap starting.
I20260809 02:30:16.611292 21564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:16.612106 21564 log.cc:824] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:30:16 dist-test-slave-68xk krb5kdc[21444](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:30:16.614318 21564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b: No bootstrap required, opened a new log
I20260809 02:30:16.617697 21564 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64b0bfde3a6b44c799fd4a08c1f9b52b" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43275 } }
I20260809 02:30:16.618005 21564 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:16.618090 21564 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64b0bfde3a6b44c799fd4a08c1f9b52b, State: Initialized, Role: FOLLOWER
I20260809 02:30:16.618604 21564 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64b0bfde3a6b44c799fd4a08c1f9b52b" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43275 } }
I20260809 02:30:16.618860 21564 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:16.618911 21570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:16.603893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41235 (local address 127.21.214.190:43275)
0809 02:30:16.604398 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:16.604419 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:16.604466 (+ 47us) server_negotiation.cc:407] Connection header received
0809 02:30:16.605393 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:16.605420 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:16.605879 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:16.606303 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:16.607217 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:16.608828 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:16.609706 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:16.610504 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:16.610677 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:16.613493 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:16.613499 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:16.613512 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:16.613541 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:16.615515 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:16.616091 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:16.616096 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:16.616101 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:16.616225 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:16.616620 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:16.616629 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:16.616631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:16.617040 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:16.617315 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:16.617602 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 02:30:16.617841 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":149,"threads_started":1}
I20260809 02:30:16.618978 21564 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:16.619103 21564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:16.620007 21564 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64b0bfde3a6b44c799fd4a08c1f9b52b" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43275 } }
I20260809 02:30:16.620352 21564 leader_election.cc:302] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64b0bfde3a6b44c799fd4a08c1f9b52b; no voters:
I20260809 02:30:16.620661 21564 leader_election.cc:288] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:16.620786 21573 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:16.621035 21573 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [term 1 LEADER]: Becoming Leader. State: Replica: 64b0bfde3a6b44c799fd4a08c1f9b52b, State: Running, Role: LEADER
I20260809 02:30:16.621431 21573 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64b0bfde3a6b44c799fd4a08c1f9b52b" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43275 } }
I20260809 02:30:16.622009 21564 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:16.622330 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:16.623317 21575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64b0bfde3a6b44c799fd4a08c1f9b52b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64b0bfde3a6b44c799fd4a08c1f9b52b" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43275 } } }
I20260809 02:30:16.623458 21575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:16.623818 21576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64b0bfde3a6b44c799fd4a08c1f9b52b. Latest consensus state: current_term: 1 leader_uuid: "64b0bfde3a6b44c799fd4a08c1f9b52b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64b0bfde3a6b44c799fd4a08c1f9b52b" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43275 } } }
I20260809 02:30:16.623937 21576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b [sys.catalog]: This master's current role is: LEADER
W20260809 02:30:16.627570 21595 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:30:16.627664 21595 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:30:16.627792 21583 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:16.628643 21583 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:16.634352 21570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:16.625045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45097 (local address 127.21.214.190:43275)
0809 02:30:16.625171 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:16.625178 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:16.625350 (+ 172us) server_negotiation.cc:407] Connection header received
0809 02:30:16.625464 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:16.625467 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:16.625514 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:16.625606 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:16.626493 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:16.627320 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:16.628432 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:16.628742 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:16.628852 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:16.630473 (+ 1621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:16.630477 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:16.630480 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:16.630507 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:16.632183 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:16.632811 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:16.632814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:16.632816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:16.632913 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:16.633343 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:16.633346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:16.633348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:16.633580 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:16.633748 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:16.634076 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 02:30:16.634197 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:30:16.634738 21583 catalog_manager.cc:1347] Generated new cluster ID: 8117dca0b2f14c69bcb75db99b7076f1
I20260809 02:30:16.634809 21583 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:16.646446 21583 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:16.647703 21583 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:16.656258 21583 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64b0bfde3a6b44c799fd4a08c1f9b52b: Generated new TSK 0
I20260809 02:30:16.657018 21583 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:16.662101 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 21460
W20260809 02:30:16.673386 21441 connection.cc:535] client connection to 127.21.214.190:43275 recv error: Network error: failed to read from TLS socket (remote: 127.21.214.190:43275): Connection reset by peer (error 104)
2026-08-09T02:30:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1641 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:16 dist-test-slave-68xk krb5kdc[21608](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:16 dist-test-slave-68xk krb5kdc[21608](info): set up 2 sockets
Aug 09 02:30:16 dist-test-slave-68xk krb5kdc[21608](info): commencing operation
krb5kdc: starting...
W20260809 02:30:17.931732 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.244s user 0.006s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:18 dist-test-slave-68xk krb5kdc[21608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:30:18.065919 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:34483
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:41329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:34483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:18.177557 21627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:18.177872 21627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:18.177959 21627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:18.181919 21627 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:18.182019 21627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:18.182065 21627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:18.182119 21627 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:18.182161 21627 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:18.187381 21627 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:34483
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:34483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:18.188462 21627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:18.189569 21627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:18.198339 21633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:18.198652 21641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:18.198695 21637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:18.198760 21627 server_base.cc:1034] running on GCE node
I20260809 02:30:18.199322 21627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:18.200445 21627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:18.201649 21627 hybrid_clock.cc:648] HybridClock initialized: now 1786242618201610 us; error 44 us; skew 500 ppm
Aug 09 02:30:18 dist-test-slave-68xk krb5kdc[21608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242618, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:18.205195 21627 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:30:18.206148 21627 webserver.cc:460] Webserver started at http://127.21.214.190:34813/ using document root <none> and password file <none>
I20260809 02:30:18.206766 21627 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:18.206833 21627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:18.207018 21627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:18.209074 21627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "983e86eb213047f69cc481b4359029e5"
format_stamp: "Formatted at 2026-08-09 02:30:18 on dist-test-slave-68xk"
server_key: "d9da49ca39e21d9854e206c7d2ab8edb"
server_key_iv: "deafea15f21a1a985170abbebd860997"
server_key_version: "encryptionkey@0"
I20260809 02:30:18.209636 21627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "983e86eb213047f69cc481b4359029e5"
format_stamp: "Formatted at 2026-08-09 02:30:18 on dist-test-slave-68xk"
server_key: "d9da49ca39e21d9854e206c7d2ab8edb"
server_key_iv: "deafea15f21a1a985170abbebd860997"
server_key_version: "encryptionkey@0"
I20260809 02:30:18.213559 21627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260809 02:30:18.216109 21652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:18.217479 21627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:30:18.217624 21627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "983e86eb213047f69cc481b4359029e5"
format_stamp: "Formatted at 2026-08-09 02:30:18 on dist-test-slave-68xk"
server_key: "d9da49ca39e21d9854e206c7d2ab8edb"
server_key_iv: "deafea15f21a1a985170abbebd860997"
server_key_version: "encryptionkey@0"
I20260809 02:30:18.217728 21627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:18.235040 21627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:18.237951 21627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:18.238168 21627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:18.245599 21627 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:34483
I20260809 02:30:18.245637 21725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:34483 every 8 connection(s)
I20260809 02:30:18.246622 21627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:18.249464 21726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:18.252529 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 21627
I20260809 02:30:18.252691 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:18.252990 22362 external_mini_cluster.cc:1428] Setting key f3f063e013c837b27ec82cedf881a4f1
I20260809 02:30:18.255966 21726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5: Bootstrap starting.
I20260809 02:30:18.258190 21726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:18.259033 21726 log.cc:824] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:18.261312 21726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5: No bootstrap required, opened a new log
I20260809 02:30:18.262742 21734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:18.254523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51817 (local address 127.21.214.190:34483)
0809 02:30:18.255001 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:18.255017 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:18.255055 (+ 38us) server_negotiation.cc:407] Connection header received
0809 02:30:18.255713 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:18.255731 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:18.256125 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:18.256494 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:18.256936 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:18.257936 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:18.258970 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:18.259575 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:18.259765 (+ 190us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:18.260763 (+ 998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:18.260768 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:18.260782 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:18.261226 (+ 444us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:18.261300 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:18.261325 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:18.261503 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:18.261711 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 02:30:18.261861 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":150,"threads_started":1}
I20260809 02:30:18.264873 21726 raft_consensus.cc:348] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "983e86eb213047f69cc481b4359029e5" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 34483 } }
I20260809 02:30:18.265144 21726 raft_consensus.cc:374] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:18.265216 21726 raft_consensus.cc:729] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 983e86eb213047f69cc481b4359029e5, State: Initialized, Role: FOLLOWER
I20260809 02:30:18.265725 21726 consensus_queue.cc:260] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "983e86eb213047f69cc481b4359029e5" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 34483 } }
I20260809 02:30:18.265933 21726 raft_consensus.cc:388] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:18.266010 21726 raft_consensus.cc:482] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:18.266119 21726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:18.266631 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:18.267230 21726 raft_consensus.cc:504] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "983e86eb213047f69cc481b4359029e5" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 34483 } }
I20260809 02:30:18.267583 21726 leader_election.cc:302] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 983e86eb213047f69cc481b4359029e5; no voters:
I20260809 02:30:18.267935 21726 leader_election.cc:288] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:18.268003 21737 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:18.268253 21737 raft_consensus.cc:686] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [term 1 LEADER]: Becoming Leader. State: Replica: 983e86eb213047f69cc481b4359029e5, State: Running, Role: LEADER
I20260809 02:30:18.268604 21737 consensus_queue.cc:237] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "983e86eb213047f69cc481b4359029e5" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 34483 } }
I20260809 02:30:18.269315 21726 sys_catalog.cc:564] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:18.269906 21742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "983e86eb213047f69cc481b4359029e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "983e86eb213047f69cc481b4359029e5" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 34483 } } }
I20260809 02:30:18.270257 21742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:18.271152 21743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 983e86eb213047f69cc481b4359029e5. Latest consensus state: current_term: 1 leader_uuid: "983e86eb213047f69cc481b4359029e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "983e86eb213047f69cc481b4359029e5" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 34483 } } }
I20260809 02:30:18.271384 21743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:18.272222 21747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:18.274353 21734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:18.269207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37837 (local address 127.21.214.190:34483)
0809 02:30:18.269326 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:18.269331 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:18.269345 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:30:18.269380 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:18.269386 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:18.269434 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:18.269505 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:18.269787 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:18.270618 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:18.271962 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:18.272332 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:18.272456 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:18.273593 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:18.273597 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:18.273599 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:18.273612 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:18.273639 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:18.273652 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:18.273758 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:18.274161 (+ 403us) server_negotiation.cc:299] Negotiation successful
0809 02:30:18.274201 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:30:18.275645 21747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:18.282945 21747 catalog_manager.cc:1347] Generated new cluster ID: 04e439cdebcc46c4bee1839d3b9f0e29
I20260809 02:30:18.283031 21747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:18.293866 21747 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:18.294922 21747 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:18.303619 21747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 983e86eb213047f69cc481b4359029e5: Generated new TSK 0
I20260809 02:30:18.304298 21747 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:18.308320 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 21627
W20260809 02:30:18.330524 21606 connection.cc:535] client connection to 127.21.214.190:34483 recv error: Network error: failed to read from TLS socket (remote: 127.21.214.190:34483): Connection reset by peer (error 104)
2026-08-09T02:30:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1657 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:18 dist-test-slave-68xk krb5kdc[21768](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:18 dist-test-slave-68xk krb5kdc[21768](info): set up 2 sockets
Aug 09 02:30:18 dist-test-slave-68xk krb5kdc[21768](info): commencing operation
krb5kdc: starting...
W20260809 02:30:19.554296 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:19 dist-test-slave-68xk krb5kdc[21768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:30:19.683442 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:33581
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:39915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:33581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:19.796466 21784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:19.796743 21784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:19.796785 21784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:19.800984 21784 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:19.801043 21784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:19.801062 21784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:19.801085 21784 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:19.801144 21784 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:19.806442 21784 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:39915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:33581
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:33581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:19.807468 21784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:19.808475 21784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:19.817258 21806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:19.817349 21800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:19.817480 21784 server_base.cc:1034] running on GCE node
W20260809 02:30:19.817344 21804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:19.818202 21784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:19.819712 21784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:19.820941 21784 hybrid_clock.cc:648] HybridClock initialized: now 1786242619820920 us; error 35 us; skew 500 ppm
Aug 09 02:30:19 dist-test-slave-68xk krb5kdc[21768](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242619, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:19.826802 21784 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:30:19.827852 21784 webserver.cc:460] Webserver started at http://127.21.214.190:39641/ using document root <none> and password file <none>
I20260809 02:30:19.828452 21784 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:19.828553 21784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:19.828812 21784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:19.831027 21784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "346d2031e2c04c8ca520656b1241d26a"
format_stamp: "Formatted at 2026-08-09 02:30:19 on dist-test-slave-68xk"
server_key: "a6e59592047c198504ac206aa3bd13c8"
server_key_iv: "9a788c0ef753485ad11025359c660f0d"
server_key_version: "encryptionkey@0"
I20260809 02:30:19.831614 21784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "346d2031e2c04c8ca520656b1241d26a"
format_stamp: "Formatted at 2026-08-09 02:30:19 on dist-test-slave-68xk"
server_key: "a6e59592047c198504ac206aa3bd13c8"
server_key_iv: "9a788c0ef753485ad11025359c660f0d"
server_key_version: "encryptionkey@0"
I20260809 02:30:19.835459 21784 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 02:30:19.837981 21815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:19.839263 21784 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 02:30:19.839424 21784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "346d2031e2c04c8ca520656b1241d26a"
format_stamp: "Formatted at 2026-08-09 02:30:19 on dist-test-slave-68xk"
server_key: "a6e59592047c198504ac206aa3bd13c8"
server_key_iv: "9a788c0ef753485ad11025359c660f0d"
server_key_version: "encryptionkey@0"
I20260809 02:30:19.839540 21784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:19.844240 21784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:19.847728 21784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:19.847939 21784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:19.855201 21784 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:33581
I20260809 02:30:19.855300 21897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:33581 every 8 connection(s)
I20260809 02:30:19.856187 21784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:19.859031 21899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:19.860489 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 21784
I20260809 02:30:19.860638 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:19.860952 22362 external_mini_cluster.cc:1428] Setting key 8ccfbfb82e5633af2e860a40899739e2
I20260809 02:30:19.865958 21899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a: Bootstrap starting.
I20260809 02:30:19.866451 21903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:19.862293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50951 (local address 127.21.214.190:33581)
0809 02:30:19.862759 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:19.862778 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:19.862821 (+ 43us) server_negotiation.cc:407] Connection header received
0809 02:30:19.863640 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:19.863662 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:19.864007 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:19.864371 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:19.865067 (+ 696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:19.865072 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:19.865086 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:19.865098 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:19.865158 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:19.865185 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:19.865330 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:19.865395 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 02:30:19.865535 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":164,"threads_started":1}
I20260809 02:30:19.868570 21899 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:19.869264 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:19.869462 21899 log.cc:824] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:19.871650 21899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a: No bootstrap required, opened a new log
I20260809 02:30:19.872946 21903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:19.871324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36415 (local address 127.21.214.190:33581)
0809 02:30:19.871435 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:19.871439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:19.871644 (+ 205us) server_negotiation.cc:407] Connection header received
0809 02:30:19.871774 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:19.871779 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:19.871815 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:19.871882 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:19.872565 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:19.872568 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:19.872570 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:19.872580 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:19.872603 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:19.872613 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:19.872681 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:19.872799 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 02:30:19.872827 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 02:30:19.875572 21899 raft_consensus.cc:348] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "346d2031e2c04c8ca520656b1241d26a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33581 } }
I20260809 02:30:19.875816 21899 raft_consensus.cc:374] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:19.875890 21899 raft_consensus.cc:729] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346d2031e2c04c8ca520656b1241d26a, State: Initialized, Role: FOLLOWER
I20260809 02:30:19.876287 21899 consensus_queue.cc:260] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "346d2031e2c04c8ca520656b1241d26a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33581 } }
I20260809 02:30:19.876448 21899 raft_consensus.cc:388] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:19.876539 21899 raft_consensus.cc:482] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:19.876643 21899 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:19.877513 21899 raft_consensus.cc:504] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "346d2031e2c04c8ca520656b1241d26a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33581 } }
I20260809 02:30:19.877862 21899 leader_election.cc:302] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 346d2031e2c04c8ca520656b1241d26a; no voters:
I20260809 02:30:19.878204 21899 leader_election.cc:288] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:19.878284 21916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:19.878510 21916 raft_consensus.cc:686] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [term 1 LEADER]: Becoming Leader. State: Replica: 346d2031e2c04c8ca520656b1241d26a, State: Running, Role: LEADER
I20260809 02:30:19.878854 21916 consensus_queue.cc:237] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "346d2031e2c04c8ca520656b1241d26a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33581 } }
I20260809 02:30:19.879534 21899 sys_catalog.cc:564] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:19.880679 21919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "346d2031e2c04c8ca520656b1241d26a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "346d2031e2c04c8ca520656b1241d26a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33581 } } }
I20260809 02:30:19.880733 21918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 346d2031e2c04c8ca520656b1241d26a. Latest consensus state: current_term: 1 leader_uuid: "346d2031e2c04c8ca520656b1241d26a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "346d2031e2c04c8ca520656b1241d26a" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33581 } } }
I20260809 02:30:19.880870 21918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:19.880879 21919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:19.881305 21930 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:19.884063 21930 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:19.889621 21930 catalog_manager.cc:1347] Generated new cluster ID: 979b1009d9a647d783bf77ad26379189
I20260809 02:30:19.889700 21930 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:19.897620 21930 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:19.897949 21930 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:19.904850 21930 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 346d2031e2c04c8ca520656b1241d26a: Generated new TSK 0
I20260809 02:30:19.905686 21930 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:19.918700 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 21784
2026-08-09T02:30:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1601 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:19 dist-test-slave-68xk krb5kdc[21943](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:19 dist-test-slave-68xk krb5kdc[21943](info): set up 2 sockets
Aug 09 02:30:19 dist-test-slave-68xk krb5kdc[21943](info): commencing operation
krb5kdc: starting...
W20260809 02:30:21.156842 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:21 dist-test-slave-68xk krb5kdc[21943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:30:21.299681 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:33173
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:38979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:33173
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:21.413753 21969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:21.414031 21969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:21.414075 21969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:21.418208 21969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:21.418269 21969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:21.418289 21969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:21.418306 21969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:21.418322 21969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:21.423713 21969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:38979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:33173
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:33173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:21.424806 21969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:21.425860 21969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:21.434763 21977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:21.434763 21975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:21.434782 21974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:21.434953 21969 server_base.cc:1034] running on GCE node
I20260809 02:30:21.435748 21969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:21.436945 21969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:21.438167 21969 hybrid_clock.cc:648] HybridClock initialized: now 1786242621438146 us; error 32 us; skew 500 ppm
Aug 09 02:30:21 dist-test-slave-68xk krb5kdc[21943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242621, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:21.441285 21969 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:30:21.442212 21969 webserver.cc:460] Webserver started at http://127.21.214.190:33959/ using document root <none> and password file <none>
I20260809 02:30:21.442847 21969 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:21.442946 21969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:21.443195 21969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:21.445258 21969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "3cc1d92d485e40648ae4d9f00a4e0808"
format_stamp: "Formatted at 2026-08-09 02:30:21 on dist-test-slave-68xk"
server_key: "feae82bd48ad907780f374491078e9f5"
server_key_iv: "b7df248d65391e22fc8edd715eb0f0e2"
server_key_version: "encryptionkey@0"
I20260809 02:30:21.445860 21969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "3cc1d92d485e40648ae4d9f00a4e0808"
format_stamp: "Formatted at 2026-08-09 02:30:21 on dist-test-slave-68xk"
server_key: "feae82bd48ad907780f374491078e9f5"
server_key_iv: "b7df248d65391e22fc8edd715eb0f0e2"
server_key_version: "encryptionkey@0"
I20260809 02:30:21.449734 21969 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 02:30:21.452440 21984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:21.453967 21969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 02:30:21.454157 21969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "3cc1d92d485e40648ae4d9f00a4e0808"
format_stamp: "Formatted at 2026-08-09 02:30:21 on dist-test-slave-68xk"
server_key: "feae82bd48ad907780f374491078e9f5"
server_key_iv: "b7df248d65391e22fc8edd715eb0f0e2"
server_key_version: "encryptionkey@0"
I20260809 02:30:21.454294 21969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:21.476698 21969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:21.480468 21969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:21.480705 21969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:21.488576 21969 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:33173
I20260809 02:30:21.488611 22066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:33173 every 8 connection(s)
I20260809 02:30:21.489594 21969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:21.492517 22068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:21.497574 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 21969
I20260809 02:30:21.497730 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:21.498034 22362 external_mini_cluster.cc:1428] Setting key d484a8976287ba5daad95e633a52c3df
I20260809 02:30:21.498649 22068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808: Bootstrap starting.
I20260809 02:30:21.501241 22068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:21.502048 22068 log.cc:824] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:21.504360 22068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808: No bootstrap required, opened a new log
Aug 09 02:30:21 dist-test-slave-68xk krb5kdc[21943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:30:21.508817 22068 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cc1d92d485e40648ae4d9f00a4e0808" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33173 } }
I20260809 02:30:21.509143 22068 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:21.509212 22068 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cc1d92d485e40648ae4d9f00a4e0808, State: Initialized, Role: FOLLOWER
I20260809 02:30:21.509744 22068 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cc1d92d485e40648ae4d9f00a4e0808" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33173 } }
I20260809 02:30:21.509909 22068 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:21.509985 22068 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:21.510098 22068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:21.511263 22068 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cc1d92d485e40648ae4d9f00a4e0808" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33173 } }
I20260809 02:30:21.511653 22068 leader_election.cc:302] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3cc1d92d485e40648ae4d9f00a4e0808; no voters:
I20260809 02:30:21.512012 22068 leader_election.cc:288] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:21.512117 22075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:21.512418 22075 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [term 1 LEADER]: Becoming Leader. State: Replica: 3cc1d92d485e40648ae4d9f00a4e0808, State: Running, Role: LEADER
I20260809 02:30:21.512800 22075 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cc1d92d485e40648ae4d9f00a4e0808" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33173 } }
I20260809 02:30:21.513336 22068 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:21.513567 22072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:21.499561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56163 (local address 127.21.214.190:33173)
0809 02:30:21.500036 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:21.500052 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:21.500089 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:30:21.500727 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:21.500742 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:21.501093 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:21.501443 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:21.502311 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:21.503700 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:21.504586 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:21.505293 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:21.505467 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:21.508049 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:21.508056 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:21.508073 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:21.508116 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:21.510308 (+ 2192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:21.510783 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:21.510789 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:21.510795 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:21.510947 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:21.511232 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:21.511238 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:21.511242 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:21.511792 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:21.512047 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:21.512325 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 02:30:21.512628 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":134,"threads_started":1}
I20260809 02:30:21.513983 22075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3cc1d92d485e40648ae4d9f00a4e0808" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cc1d92d485e40648ae4d9f00a4e0808" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33173 } } }
I20260809 02:30:21.514101 22075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:21.514345 22075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cc1d92d485e40648ae4d9f00a4e0808. Latest consensus state: current_term: 1 leader_uuid: "3cc1d92d485e40648ae4d9f00a4e0808" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cc1d92d485e40648ae4d9f00a4e0808" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 33173 } } }
I20260809 02:30:21.514492 22075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:21.514909 22090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:21.516860 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:21.518003 22090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:21.524076 22090 catalog_manager.cc:1347] Generated new cluster ID: 6b86465d54424facbe1eb02d8096ce5f
I20260809 02:30:21.524147 22090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:21.528621 22072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:21.519212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40615 (local address 127.21.214.190:33173)
0809 02:30:21.519321 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:21.519325 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:21.519657 (+ 332us) server_negotiation.cc:407] Connection header received
0809 02:30:21.519784 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:21.519787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:21.519830 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:21.519924 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:21.520738 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:21.521508 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:21.522690 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:21.522957 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:21.523080 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:21.524960 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:21.524964 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:21.524967 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:21.524993 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:21.526852 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:21.527344 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:21.527348 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:21.527350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:21.527444 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:21.527730 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:21.527734 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:21.527735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:21.527953 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:21.528087 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:21.528335 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 02:30:21.528462 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 02:30:21.536969 22090 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:21.537937 22090 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:21.541818 22090 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3cc1d92d485e40648ae4d9f00a4e0808: Generated new TSK 0
I20260809 02:30:21.542577 22090 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:21.549785 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 21969
2026-08-09T02:30:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1631 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:21 dist-test-slave-68xk krb5kdc[22127](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:21 dist-test-slave-68xk krb5kdc[22127](info): set up 2 sockets
Aug 09 02:30:21 dist-test-slave-68xk krb5kdc[22127](info): commencing operation
krb5kdc: starting...
W20260809 02:30:23.259265 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.682s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:23 dist-test-slave-68xk krb5kdc[22127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242623, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:30:23.402402 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:43693
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:32785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:43693
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:23.522437 22146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:23.522706 22146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:23.522749 22146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:23.526724 22146 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:23.526780 22146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:23.526800 22146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:23.526816 22146 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:23.526832 22146 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:23.532819 22146 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:32785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:43693
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:43693
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:23.533895 22146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:23.535001 22146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:23.544852 22159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:23.544875 22155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:23.544859 22156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:23.545295 22146 server_base.cc:1034] running on GCE node
I20260809 02:30:23.545827 22146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:23.547088 22146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:23.548314 22146 hybrid_clock.cc:648] HybridClock initialized: now 1786242623548297 us; error 36 us; skew 500 ppm
Aug 09 02:30:23 dist-test-slave-68xk krb5kdc[22127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242623, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:23.551383 22146 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:30:23.552335 22146 webserver.cc:460] Webserver started at http://127.21.214.190:40451/ using document root <none> and password file <none>
I20260809 02:30:23.552989 22146 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:23.553098 22146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:23.553366 22146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:23.555763 22146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "708e2407f1c94308835f1c18a3d5bf61"
format_stamp: "Formatted at 2026-08-09 02:30:23 on dist-test-slave-68xk"
server_key: "e3539c1a333cebb5edd7cc22b000fdce"
server_key_iv: "fdee58cb9e6472fd861d631cffe57871"
server_key_version: "encryptionkey@0"
I20260809 02:30:23.556389 22146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "708e2407f1c94308835f1c18a3d5bf61"
format_stamp: "Formatted at 2026-08-09 02:30:23 on dist-test-slave-68xk"
server_key: "e3539c1a333cebb5edd7cc22b000fdce"
server_key_iv: "fdee58cb9e6472fd861d631cffe57871"
server_key_version: "encryptionkey@0"
I20260809 02:30:23.560540 22146 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 02:30:23.563292 22168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:23.564597 22146 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:30:23.564791 22146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "708e2407f1c94308835f1c18a3d5bf61"
format_stamp: "Formatted at 2026-08-09 02:30:23 on dist-test-slave-68xk"
server_key: "e3539c1a333cebb5edd7cc22b000fdce"
server_key_iv: "fdee58cb9e6472fd861d631cffe57871"
server_key_version: "encryptionkey@0"
I20260809 02:30:23.564920 22146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:23.598891 22146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:23.602458 22146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:23.602727 22146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:23.610733 22146 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:43693
I20260809 02:30:23.610756 22250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:43693 every 8 connection(s)
I20260809 02:30:23.611795 22146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:23.614745 22251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:23.620365 22251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61: Bootstrap starting.
I20260809 02:30:23.620802 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 22146
I20260809 02:30:23.620980 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:23.621289 22362 external_mini_cluster.cc:1428] Setting key c979b6301916c19fc7fde6089a2ad7e4
I20260809 02:30:23.623191 22251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:23.623967 22251 log.cc:824] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:23.625833 22251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61: No bootstrap required, opened a new log
I20260809 02:30:23.629523 22251 raft_consensus.cc:348] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708e2407f1c94308835f1c18a3d5bf61" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43693 } }
I20260809 02:30:23.629771 22251 raft_consensus.cc:374] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:23.629864 22251 raft_consensus.cc:729] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 708e2407f1c94308835f1c18a3d5bf61, State: Initialized, Role: FOLLOWER
I20260809 02:30:23.630388 22251 consensus_queue.cc:260] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708e2407f1c94308835f1c18a3d5bf61" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43693 } }
I20260809 02:30:23.630602 22251 raft_consensus.cc:388] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:23.630671 22251 raft_consensus.cc:482] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:23.630769 22251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:23.631160 22254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:23.622746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51389 (local address 127.21.214.190:43693)
0809 02:30:23.623195 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:23.623213 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:23.623250 (+ 37us) server_negotiation.cc:407] Connection header received
0809 02:30:23.623968 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:23.623986 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:23.624404 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:23.624768 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:23.625235 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:23.626365 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:23.627409 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:23.627946 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:23.628163 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:23.629090 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:23.629096 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:23.629109 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:23.629524 (+ 415us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:23.629593 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:23.629616 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:23.629734 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:23.629914 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 02:30:23.630136 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":144,"threads_started":1}
I20260809 02:30:23.631889 22251 raft_consensus.cc:504] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708e2407f1c94308835f1c18a3d5bf61" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43693 } }
I20260809 02:30:23.632247 22251 leader_election.cc:302] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 708e2407f1c94308835f1c18a3d5bf61; no voters:
I20260809 02:30:23.632571 22251 leader_election.cc:288] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:23.632678 22256 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:23.632910 22256 raft_consensus.cc:686] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [term 1 LEADER]: Becoming Leader. State: Replica: 708e2407f1c94308835f1c18a3d5bf61, State: Running, Role: LEADER
I20260809 02:30:23.633299 22256 consensus_queue.cc:237] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708e2407f1c94308835f1c18a3d5bf61" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43693 } }
I20260809 02:30:23.633945 22251 sys_catalog.cc:564] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:23.634310 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:23.635113 22258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "708e2407f1c94308835f1c18a3d5bf61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708e2407f1c94308835f1c18a3d5bf61" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43693 } } }
I20260809 02:30:23.635309 22258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:23.635603 22258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 708e2407f1c94308835f1c18a3d5bf61. Latest consensus state: current_term: 1 leader_uuid: "708e2407f1c94308835f1c18a3d5bf61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "708e2407f1c94308835f1c18a3d5bf61" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 43693 } } }
I20260809 02:30:23.635762 22258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61 [sys.catalog]: This master's current role is: LEADER
W20260809 02:30:23.639709 22285 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:30:23.639789 22285 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:30:23.639846 22272 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:23.640825 22272 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:23.641467 22254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:23.637130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37389 (local address 127.21.214.190:43693)
0809 02:30:23.637275 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:23.637280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:23.637294 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:30:23.637331 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:23.637334 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:23.637388 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:23.637479 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:23.637722 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:23.638493 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:23.639638 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:23.639974 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:23.640086 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:23.641011 (+ 925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:23.641015 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:23.641017 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:23.641030 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:23.641057 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:23.641071 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:23.641145 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:23.641291 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 02:30:23.641346 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 02:30:23.647022 22272 catalog_manager.cc:1347] Generated new cluster ID: 5020dfe009bc4703a7482bbdb24a8575
I20260809 02:30:23.647149 22272 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:23.658875 22272 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:23.659821 22272 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:23.671160 22272 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 708e2407f1c94308835f1c18a3d5bf61: Generated new TSK 0
I20260809 02:30:23.671898 22272 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:23.679689 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 22146
2026-08-09T02:30:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2133 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:23 dist-test-slave-68xk krb5kdc[22296](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:23 dist-test-slave-68xk krb5kdc[22296](info): set up 2 sockets
Aug 09 02:30:23 dist-test-slave-68xk krb5kdc[22296](info): commencing operation
krb5kdc: starting...
W20260809 02:30:24.932528 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:25 dist-test-slave-68xk krb5kdc[22296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:30:25.070336 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:38071
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:42035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:38071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:25.185935 22316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:25.186256 22316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:25.186338 22316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:25.190325 22316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:25.190428 22316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:25.190490 22316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:25.190524 22316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:25.190553 22316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:25.195815 22316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:42035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:38071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:38071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:25.196913 22316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:25.197961 22316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:25.206662 22326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:25.206722 22330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:25.206851 22316 server_base.cc:1034] running on GCE node
W20260809 02:30:25.206667 22327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:25.207592 22316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:25.208694 22316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:25.209857 22316 hybrid_clock.cc:648] HybridClock initialized: now 1786242625209843 us; error 30 us; skew 500 ppm
Aug 09 02:30:25 dist-test-slave-68xk krb5kdc[22296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242625, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:25.216672 22316 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:30:25.217722 22316 webserver.cc:460] Webserver started at http://127.21.214.190:45747/ using document root <none> and password file <none>
I20260809 02:30:25.218326 22316 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:25.218391 22316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:25.218703 22316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:25.220769 22316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "a1c7cf3884c744528c65eeb849b3d5e8"
format_stamp: "Formatted at 2026-08-09 02:30:25 on dist-test-slave-68xk"
server_key: "3bb3e83f7d14aebd11ccc9b07f161749"
server_key_iv: "ff6b53baefa698e97748316f46243143"
server_key_version: "encryptionkey@0"
I20260809 02:30:25.221374 22316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "a1c7cf3884c744528c65eeb849b3d5e8"
format_stamp: "Formatted at 2026-08-09 02:30:25 on dist-test-slave-68xk"
server_key: "3bb3e83f7d14aebd11ccc9b07f161749"
server_key_iv: "ff6b53baefa698e97748316f46243143"
server_key_version: "encryptionkey@0"
I20260809 02:30:25.225227 22316 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 02:30:25.227841 22346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:25.229059 22316 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 02:30:25.229206 22316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "a1c7cf3884c744528c65eeb849b3d5e8"
format_stamp: "Formatted at 2026-08-09 02:30:25 on dist-test-slave-68xk"
server_key: "3bb3e83f7d14aebd11ccc9b07f161749"
server_key_iv: "ff6b53baefa698e97748316f46243143"
server_key_version: "encryptionkey@0"
I20260809 02:30:25.229343 22316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:25.233969 22316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:25.236912 22316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:25.237113 22316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:25.244570 22316 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:38071
I20260809 02:30:25.244599 22437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:38071 every 8 connection(s)
I20260809 02:30:25.245539 22316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:25.247686 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 22316
I20260809 02:30:25.247844 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:25.248134 22362 external_mini_cluster.cc:1428] Setting key 1199c215573e84973be6e39a553c3d63
I20260809 02:30:25.248433 22438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:25.253295 22441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:25.249556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36953 (local address 127.21.214.190:38071)
0809 02:30:25.249988 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:25.250002 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:25.250036 (+ 34us) server_negotiation.cc:407] Connection header received
0809 02:30:25.250771 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:25.250788 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:25.251048 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:25.251384 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:25.252165 (+ 781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:25.252169 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:25.252181 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:25.252191 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:25.252243 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:25.252268 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:25.252423 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:25.252494 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 02:30:25.252645 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":137,"threads_started":1}
I20260809 02:30:25.255326 22438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8: Bootstrap starting.
I20260809 02:30:25.256131 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:25.257771 22438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:25.258692 22438 log.cc:824] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:25.259981 22441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:25.258227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40199 (local address 127.21.214.190:38071)
0809 02:30:25.258356 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:25.258360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:25.258584 (+ 224us) server_negotiation.cc:407] Connection header received
0809 02:30:25.258696 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:25.258698 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:25.258726 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:25.258801 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:25.259580 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:25.259584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:25.259590 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 02:30:25.259601 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:25.259623 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 02:30:25.259632 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:25.259699 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:25.259821 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 02:30:25.259848 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 02:30:25.261164 22438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8: No bootstrap required, opened a new log
I20260809 02:30:25.264747 22438 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1c7cf3884c744528c65eeb849b3d5e8" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38071 } }
I20260809 02:30:25.265018 22438 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 02:30:25.265123 22438 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c7cf3884c744528c65eeb849b3d5e8, State: Initialized, Role: FOLLOWER
I20260809 02:30:25.265601 22438 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1c7cf3884c744528c65eeb849b3d5e8" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38071 } }
I20260809 02:30:25.265771 22438 raft_consensus.cc:388] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 02:30:25.265887 22438 raft_consensus.cc:482] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 02:30:25.266000 22438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:25.266934 22438 raft_consensus.cc:504] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1c7cf3884c744528c65eeb849b3d5e8" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38071 } }
I20260809 02:30:25.267220 22438 leader_election.cc:302] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1c7cf3884c744528c65eeb849b3d5e8; no voters:
I20260809 02:30:25.267473 22438 leader_election.cc:288] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 02:30:25.267606 22454 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:25.267871 22454 raft_consensus.cc:686] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [term 1 LEADER]: Becoming Leader. State: Replica: a1c7cf3884c744528c65eeb849b3d5e8, State: Running, Role: LEADER
I20260809 02:30:25.268196 22454 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1c7cf3884c744528c65eeb849b3d5e8" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38071 } }
I20260809 02:30:25.268680 22438 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:25.269831 22456 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1c7cf3884c744528c65eeb849b3d5e8. Latest consensus state: current_term: 1 leader_uuid: "a1c7cf3884c744528c65eeb849b3d5e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1c7cf3884c744528c65eeb849b3d5e8" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38071 } } }
I20260809 02:30:25.269966 22456 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:25.270347 22466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:25.270972 22455 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1c7cf3884c744528c65eeb849b3d5e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1c7cf3884c744528c65eeb849b3d5e8" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 38071 } } }
I20260809 02:30:25.271117 22455 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:25.272958 22466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:25.277985 22466 catalog_manager.cc:1347] Generated new cluster ID: 4a016652ccd94b83bae27aa473bae11a
I20260809 02:30:25.278052 22466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:25.294282 22466 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:25.294688 22466 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:25.303340 22466 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a1c7cf3884c744528c65eeb849b3d5e8: Generated new TSK 0
I20260809 02:30:25.304294 22466 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 02:30:25.314795 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 22316
2026-08-09T02:30:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1630 ms)
[----------] 18 tests from AuthTokenIssuingTest (30207 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:25 dist-test-slave-68xk krb5kdc[22486](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:25 dist-test-slave-68xk krb5kdc[22486](info): set up 2 sockets
Aug 09 02:30:25 dist-test-slave-68xk krb5kdc[22486](info): commencing operation
krb5kdc: starting...
W20260809 02:30:26.604785 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:26 dist-test-slave-68xk krb5kdc[22486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:30:26.745682 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:45565
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:37365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:45565,127.21.214.189:40385,127.21.214.188:42075
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:26.859673 22505 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:30:26.859970 22505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:26.859993 22505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:26.860031 22505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:26.864871 22505 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:26.864941 22505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:26.864962 22505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:26.864979 22505 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:26.864995 22505 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:26.870307 22505 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:37365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:45565,127.21.214.189:40385,127.21.214.188:42075
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:45565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:26.871454 22505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:26.872459 22505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:26.881315 22516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:26.881451 22505 server_base.cc:1034] running on GCE node
W20260809 02:30:26.881330 22514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:26.881619 22513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:26.882200 22505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:26.883380 22505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:26.884549 22505 hybrid_clock.cc:648] HybridClock initialized: now 1786242626884522 us; error 42 us; skew 500 ppm
Aug 09 02:30:26 dist-test-slave-68xk krb5kdc[22486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242626, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:26.887512 22505 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:30:26.888428 22505 webserver.cc:460] Webserver started at http://127.21.214.190:41671/ using document root <none> and password file <none>
I20260809 02:30:26.888994 22505 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:26.889092 22505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:26.889339 22505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:26.891445 22505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "17564be3759a461b9806bf5643f82e5d"
format_stamp: "Formatted at 2026-08-09 02:30:26 on dist-test-slave-68xk"
server_key: "d4130c4661a3a585818fac52608a6d9e"
server_key_iv: "15c254b8f48f926be19c883a17e45eb5"
server_key_version: "encryptionkey@0"
I20260809 02:30:26.892028 22505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "17564be3759a461b9806bf5643f82e5d"
format_stamp: "Formatted at 2026-08-09 02:30:26 on dist-test-slave-68xk"
server_key: "d4130c4661a3a585818fac52608a6d9e"
server_key_iv: "15c254b8f48f926be19c883a17e45eb5"
server_key_version: "encryptionkey@0"
I20260809 02:30:26.895731 22505 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 02:30:26.898078 22526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:26.899336 22505 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:30:26.899487 22505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "17564be3759a461b9806bf5643f82e5d"
format_stamp: "Formatted at 2026-08-09 02:30:26 on dist-test-slave-68xk"
server_key: "d4130c4661a3a585818fac52608a6d9e"
server_key_iv: "15c254b8f48f926be19c883a17e45eb5"
server_key_version: "encryptionkey@0"
I20260809 02:30:26.899601 22505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:26.908344 22505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:26.911588 22505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:26.911801 22505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:26.919231 22505 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:45565
I20260809 02:30:26.919541 22613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:45565 every 8 connection(s)
I20260809 02:30:26.920224 22505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:26.923128 22614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:26.923115 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 22505
I20260809 02:30:26.923242 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:26.923537 22362 external_mini_cluster.cc:1428] Setting key fe39266c4b898fafaba586784aa047b4
I20260809 02:30:26.927671 22614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.21.214.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.189@KRBTEST.COM" created.
Aug 09 02:30:26 dist-test-slave-68xk krb5kdc[22486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242626, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:30:26.944136 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:26.930220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45565 (local address 127.0.0.1:39964)
0809 02:30:26.930775 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:26.930817 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:26.931771 (+ 954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:26.932451 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:26.932457 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:26.932905 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:26.933140 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:26.933153 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:26.934310 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:26.934313 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:26.935099 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:26.935108 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:26.935760 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:26.935765 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:26.935883 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:26.936512 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:26.936535 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:26.938404 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:26.940760 (+ 2356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:26.940774 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:26.940788 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:26.941148 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:26.941500 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:26.941503 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:26.941505 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:26.941675 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:26.942315 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:26.942324 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:26.942577 (+ 253us) client_negotiation.cc:769] Sending connection context
0809 02:30:26.942795 (+ 218us) client_negotiation.cc:240] Negotiation successful
0809 02:30:26.943224 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":167,"threads_started":1}
I20260809 02:30:26.944201 22620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:26.931257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39964 (local address 127.21.214.190:45565)
0809 02:30:26.931566 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:26.931577 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:26.931625 (+ 48us) server_negotiation.cc:407] Connection header received
0809 02:30:26.932083 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:26.932087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:26.932266 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:26.932453 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:26.933299 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:26.934161 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:26.935226 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:26.935596 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:26.935772 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:26.938644 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:26.938654 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:26.938672 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:26.938703 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:26.940615 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:26.941285 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:26.941290 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:26.941291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:26.941397 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:26.941797 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:26.941800 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:26.941801 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:26.942180 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:26.942291 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:26.943092 (+ 801us) server_negotiation.cc:299] Negotiation successful
0809 02:30:26.943289 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":199,"thread_start_us":92,"threads_started":1}
I20260809 02:30:26.946678 22614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:30:26.947415 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:26.947152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40385 (local address 127.0.0.1:48846)
0809 02:30:26.947282 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:26.947355 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 02:30:26.947696 22528 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40385: connect: Connection refused (error 111)
I20260809 02:30:26.948632 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:26.948400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40385 (local address 127.0.0.1:48848)
0809 02:30:26.948534 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:26.948580 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260809 02:30:26.948812 22614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.189:40385: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40385: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.189.keytab.
Entry for principal kudu/127.21.214.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.189.keytab.
I20260809 02:30:26.954792 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.189:40385
--webserver_interface=127.21.214.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.189.keytab
--principal=kudu/127.21.214.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:37365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:45565,127.21.214.189:40385,127.21.214.188:42075
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:30:26.998090 22614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } attempt: 1
I20260809 02:30:26.999120 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:26.998784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40385 (local address 127.0.0.1:48854)
0809 02:30:26.998955 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:26.999031 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 02:30:27.000052 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:26.999765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40385 (local address 127.0.0.1:48866)
0809 02:30:26.999873 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:26.999929 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 02:30:27.000526 22614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.189:40385: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40385: connect: Connection refused (error 111)
I20260809 02:30:27.068748 22614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } attempt: 2
I20260809 02:30:27.069732 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.069411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40385 (local address 127.0.0.1:48882)
0809 02:30:27.069585 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.069651 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 02:30:27.070533 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.070268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40385 (local address 127.0.0.1:48888)
0809 02:30:27.070384 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.070476 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 02:30:27.070654 22614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.189:40385: Network error: Client connection negotiation failed: client connection to 127.21.214.189:40385: connect: Connection refused (error 111)
W20260809 02:30:27.081864 22624 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:30:27.082218 22624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:27.082286 22624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:27.082360 22624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:27.086385 22624 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:27.086537 22624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:27.086578 22624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:27.086615 22624 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:27.086650 22624 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:27.092079 22624 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:37365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:45565,127.21.214.189:40385,127.21.214.188:42075
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.189.keytab
--principal=kudu/127.21.214.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.189:40385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.214.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:27.093209 22624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:27.094254 22624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:27.103308 22633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:27.103410 22630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:27.103493 22624 server_base.cc:1034] running on GCE node
W20260809 02:30:27.103327 22636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:27.104266 22624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:27.105371 22624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:27.106581 22624 hybrid_clock.cc:648] HybridClock initialized: now 1786242627106566 us; error 30 us; skew 500 ppm
Aug 09 02:30:27 dist-test-slave-68xk krb5kdc[22486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242627, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:27.109686 22624 init.cc:377] Logged in from keytab as kudu/127.21.214.189@KRBTEST.COM (short username kudu)
I20260809 02:30:27.110706 22624 webserver.cc:460] Webserver started at http://127.21.214.189:41131/ using document root <none> and password file <none>
I20260809 02:30:27.111327 22624 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:27.111436 22624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:27.111691 22624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:27.113938 22624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/data/instance:
uuid: "39b88d91e719403184819c6d123c6b15"
format_stamp: "Formatted at 2026-08-09 02:30:27 on dist-test-slave-68xk"
server_key: "cd936ee4596994442471242616319030"
server_key_iv: "46665cb7498056b4a97f878d28ad27a3"
server_key_version: "encryptionkey@0"
I20260809 02:30:27.114632 22624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/wal/instance:
uuid: "39b88d91e719403184819c6d123c6b15"
format_stamp: "Formatted at 2026-08-09 02:30:27 on dist-test-slave-68xk"
server_key: "cd936ee4596994442471242616319030"
server_key_iv: "46665cb7498056b4a97f878d28ad27a3"
server_key_version: "encryptionkey@0"
I20260809 02:30:27.118728 22624 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 02:30:27.121384 22652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:27.122860 22624 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:30:27.123023 22624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/wal
uuid: "39b88d91e719403184819c6d123c6b15"
format_stamp: "Formatted at 2026-08-09 02:30:27 on dist-test-slave-68xk"
server_key: "cd936ee4596994442471242616319030"
server_key_iv: "46665cb7498056b4a97f878d28ad27a3"
server_key_version: "encryptionkey@0"
I20260809 02:30:27.123149 22624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:27.136325 22624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:27.139993 22624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:27.140228 22624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:27.148746 22624 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.189:40385
I20260809 02:30:27.149075 22727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.189:40385 every 8 connection(s)
I20260809 02:30:27.149914 22624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/data/info.pb
I20260809 02:30:27.152674 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 22624
I20260809 02:30:27.152786 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-1/wal/instance
I20260809 02:30:27.153081 22728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:27.153097 22362 external_mini_cluster.cc:1428] Setting key e7b944ce7343be6e0e5b0e0c3c1bba1a
I20260809 02:30:27.158814 22728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:30:27.161798 22614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } attempt: 3
WARNING: no policy specified for kudu/127.21.214.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.188@KRBTEST.COM" created.
Aug 09 02:30:27 dist-test-slave-68xk krb5kdc[22486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242626, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for kudu/127.21.214.189@KRBTEST.COM
Aug 09 02:30:27 dist-test-slave-68xk krb5kdc[22486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242627, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.189@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:30:27.175069 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.162199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40385 (local address 127.0.0.1:48896)
0809 02:30:27.162382 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.162397 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:27.162530 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:27.164689 (+ 2159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:27.164691 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:27.164886 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:27.165014 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.165021 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.166392 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.166396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.167240 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.167260 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.168315 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.168322 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.168448 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.168970 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:27.168990 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:27.170785 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:27.173029 (+ 2244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.173034 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.173037 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.173241 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.173637 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.173640 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.173642 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.173731 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.174517 (+ 786us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:27.174520 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:27.174609 (+ 89us) client_negotiation.cc:769] Sending connection context
0809 02:30:27.174727 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 02:30:27.174895 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
I20260809 02:30:27.176213 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.162373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48896 (local address 127.21.214.189:40385)
0809 02:30:27.162921 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.162937 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.162985 (+ 48us) server_negotiation.cc:407] Connection header received
0809 02:30:27.164138 (+ 1153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.164166 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.164453 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.164732 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.165163 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.166273 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.167425 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.168171 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.168323 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.170953 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.170961 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.170977 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.171009 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.172932 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.173363 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.173369 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.173375 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.173515 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.173841 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.173844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.173846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.174303 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.174466 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.174904 (+ 438us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.175202 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":424,"thread_start_us":189,"threads_started":1}
I20260809 02:30:27.177762 22620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.161545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39970 (local address 127.21.214.190:45565)
0809 02:30:27.161723 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.161728 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.163009 (+ 1281us) server_negotiation.cc:407] Connection header received
0809 02:30:27.164396 (+ 1387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.164399 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.164455 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.164555 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.165615 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.166122 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.167544 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.167855 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.167970 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.172307 (+ 4337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.172314 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.172319 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.172353 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.175548 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.176128 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.176133 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.176135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.176229 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.176608 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.176611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.176613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.176827 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.176929 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.177411 (+ 482us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.177569 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 02:30:27.178294 22614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:30:27.178432 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.161938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45565 (local address 127.0.0.1:39970)
0809 02:30:27.162858 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.162909 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:27.164137 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:27.164609 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:27.164618 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:27.165098 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:27.165469 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.165484 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.166237 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.166243 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.167412 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.167421 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.169801 (+ 2380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.169810 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.169898 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.170501 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:27.170524 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:27.172101 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:27.175675 (+ 3574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.175683 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.175688 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.175965 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.176350 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.176356 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.176360 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.176468 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.176970 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:27.176980 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:27.177131 (+ 151us) client_negotiation.cc:769] Sending connection context
0809 02:30:27.177982 (+ 851us) client_negotiation.cc:240] Negotiation successful
0809 02:30:27.178199 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"mutex_wait_us":1,"thread_start_us":144,"threads_started":1}
I20260809 02:30:27.179068 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.178774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:35904)
0809 02:30:27.178950 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.179007 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 02:30:27.179697 22728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:30:27.179944 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.179675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:35912)
0809 02:30:27.179838 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.179888 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260809 02:30:27.180181 22614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:42075: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
Aug 09 02:30:27 dist-test-slave-68xk krb5kdc[22486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242627, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.189@KRBTEST.COM for kudu/127.21.214.189@KRBTEST.COM
I20260809 02:30:27.188241 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.180232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40385 (local address 127.0.0.1:48904)
0809 02:30:27.180359 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.180371 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:27.180437 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:27.180735 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:27.180739 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:27.180929 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:27.181056 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.181062 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.181727 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.181730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.182272 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.182281 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.182874 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.182878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.182976 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.183378 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:27.183391 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:27.184805 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:27.186603 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.186606 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.186607 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.186919 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.187191 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.187194 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.187195 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.187325 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.187713 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:27.187716 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:27.187839 (+ 123us) client_negotiation.cc:769] Sending connection context
0809 02:30:27.187988 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 02:30:27.188129 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 02:30:27.188329 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.180450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48904 (local address 127.21.214.189:40385)
0809 02:30:27.180553 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.180557 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.180570 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:30:27.180604 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.180606 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.180638 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.180698 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.181160 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.181633 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.182455 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.182713 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.182838 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.184946 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.184949 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.184951 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.184972 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.186499 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.187018 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.187020 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.187021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.187092 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.187426 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.187429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.187430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.187589 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.187667 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.188056 (+ 389us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.188203 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":42}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.188.keytab.
Entry for principal kudu/127.21.214.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.188.keytab.
I20260809 02:30:27.189301 22728 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:30:27.189729 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.188:42075
--webserver_interface=127.21.214.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.188.keytab
--principal=kudu/127.21.214.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:37365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:45565,127.21.214.189:40385,127.21.214.188:42075
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:30:27.190065 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.189745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:35924)
0809 02:30:27.189898 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.190007 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 02:30:27.190920 22657 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
I20260809 02:30:27.191887 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.191592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:35940)
0809 02:30:27.191749 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.191815 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260809 02:30:27.192093 22728 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:42075: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
I20260809 02:30:27.211362 22614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } attempt: 1
I20260809 02:30:27.212212 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.211872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:35944)
0809 02:30:27.212044 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.212120 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 02:30:27.212937 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.212713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:35954)
0809 02:30:27.212822 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.212873 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 02:30:27.213088 22614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:42075: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
I20260809 02:30:27.241382 22728 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } attempt: 1
I20260809 02:30:27.242311 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.241949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:35970)
0809 02:30:27.242140 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.242217 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 02:30:27.243108 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.242862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:35978)
0809 02:30:27.242977 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.243031 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 02:30:27.243257 22728 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:42075: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
I20260809 02:30:27.288293 22614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } attempt: 2
I20260809 02:30:27.289258 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.288907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:35982)
0809 02:30:27.289087 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.289171 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 02:30:27.290107 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.289875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:35994)
0809 02:30:27.289994 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.290045 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 02:30:27.290285 22614 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:42075: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
W20260809 02:30:27.305390 22738 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:30:27.305655 22738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:27.305723 22738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:27.305830 22738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:27.309840 22738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:27.309892 22738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:27.309913 22738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:27.309962 22738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:27.309995 22738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:27.311431 22728 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } attempt: 2
I20260809 02:30:27.312322 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.311927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:35996)
0809 02:30:27.312095 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.312195 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 02:30:27.313637 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.313337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:35998)
0809 02:30:27.313463 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.313542 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 02:30:27.313969 22728 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:42075: Network error: Client connection negotiation failed: client connection to 127.21.214.188:42075: connect: Connection refused (error 111)
I20260809 02:30:27.316443 22738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:37365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:45565,127.21.214.189:40385,127.21.214.188:42075
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.188.keytab
--principal=kudu/127.21.214.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.188:42075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.214.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:27.317505 22738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:27.318614 22738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:27.327071 22751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:27.326987 22754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:27.327244 22763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:27.327261 22738 server_base.cc:1034] running on GCE node
I20260809 02:30:27.327975 22738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:27.329046 22738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:27.330291 22738 hybrid_clock.cc:648] HybridClock initialized: now 1786242627330273 us; error 39 us; skew 500 ppm
Aug 09 02:30:27 dist-test-slave-68xk krb5kdc[22486](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242627, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:27.333339 22738 init.cc:377] Logged in from keytab as kudu/127.21.214.188@KRBTEST.COM (short username kudu)
I20260809 02:30:27.334347 22738 webserver.cc:460] Webserver started at http://127.21.214.188:33699/ using document root <none> and password file <none>
I20260809 02:30:27.334981 22738 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:27.335103 22738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:27.335354 22738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:27.337589 22738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/data/instance:
uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a"
format_stamp: "Formatted at 2026-08-09 02:30:27 on dist-test-slave-68xk"
server_key: "58d8cebbd9b694c28f64c665ca517494"
server_key_iv: "bfd9f2c1c67fb4a8cd54a9ac13a6ce81"
server_key_version: "encryptionkey@0"
I20260809 02:30:27.338217 22738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/wal/instance:
uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a"
format_stamp: "Formatted at 2026-08-09 02:30:27 on dist-test-slave-68xk"
server_key: "58d8cebbd9b694c28f64c665ca517494"
server_key_iv: "bfd9f2c1c67fb4a8cd54a9ac13a6ce81"
server_key_version: "encryptionkey@0"
I20260809 02:30:27.342254 22738 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 02:30:27.345059 22771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:27.346405 22738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 02:30:27.346644 22738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/wal
uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a"
format_stamp: "Formatted at 2026-08-09 02:30:27 on dist-test-slave-68xk"
server_key: "58d8cebbd9b694c28f64c665ca517494"
server_key_iv: "bfd9f2c1c67fb4a8cd54a9ac13a6ce81"
server_key_version: "encryptionkey@0"
I20260809 02:30:27.346777 22738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:27.370609 22738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:27.373971 22738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:27.374248 22738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:27.382175 22738 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.188:42075
I20260809 02:30:27.382551 22853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.188:42075 every 8 connection(s)
I20260809 02:30:27.383337 22738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/data/info.pb
I20260809 02:30:27.386133 22855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:27.387094 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 22738
I20260809 02:30:27.387224 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786242328272206-22362-0/minicluster-data/master-2/wal/instance
I20260809 02:30:27.387563 22362 external_mini_cluster.cc:1428] Setting key 72f2e491f39cbee8a54eec4fe07b5ebe
I20260809 02:30:27.389499 22614 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } attempt: 3
I20260809 02:30:27.390992 22855 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:30:27 dist-test-slave-68xk krb5kdc[22486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242626, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for kudu/127.21.214.188@KRBTEST.COM
Aug 09 02:30:27 dist-test-slave-68xk krb5kdc[22486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.188@KRBTEST.COM
Aug 09 02:30:27 dist-test-slave-68xk krb5kdc[22486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242627, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.188@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:30:27.402261 22618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.389985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:36022)
0809 02:30:27.390175 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.390191 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:27.390276 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:27.391020 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:27.391024 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:27.391229 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:27.391359 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.391369 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.393057 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.393060 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.393620 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.393629 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.394654 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.394657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.394738 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.395295 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:27.395309 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:27.396951 (+ 1642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:27.400143 (+ 3192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.400148 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.400150 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.400381 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.400766 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.400769 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.400771 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.400885 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.401653 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:27.401656 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:27.401760 (+ 104us) client_negotiation.cc:769] Sending connection context
0809 02:30:27.401868 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 02:30:27.402037 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"spinlock_wait_cycles":384}
I20260809 02:30:27.403329 22858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.388891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36008 (local address 127.21.214.188:42075)
0809 02:30:27.389310 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.389324 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.389359 (+ 35us) server_negotiation.cc:407] Connection header received
0809 02:30:27.390275 (+ 916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.390302 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.390724 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.391056 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.391907 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.392899 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.394102 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.394598 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.395148 (+ 550us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.397955 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.397959 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.397961 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.397999 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.400123 (+ 2124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.400647 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.400653 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.400656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.400738 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.401042 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.401047 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.401051 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.401541 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.402324 (+ 783us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.402398 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.402521 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":91,"server-negotiator.queue_time_us":254,"spinlock_wait_cycles":1792,"thread_start_us":134,"threads_started":1}
I20260809 02:30:27.403329 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.390068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36022 (local address 127.21.214.188:42075)
0809 02:30:27.390433 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.390443 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.390459 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:30:27.390499 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.390501 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.390723 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.391481 (+ 758us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.391609 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.392902 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.393743 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.394534 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.394710 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.397124 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.397131 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.397142 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.397174 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.400020 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.400498 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.400504 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.400509 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.400632 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.401013 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.401018 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.401023 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.401548 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.401678 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.402019 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.402293 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":197,"server-negotiator.queue_time_us":260,"spinlock_wait_cycles":22528,"thread_start_us":130,"threads_started":1}
I20260809 02:30:27.404973 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.392884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:45565 (local address 127.0.0.1:39980)
0809 02:30:27.393732 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.393780 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:27.393900 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:27.394247 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:27.394253 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:27.394769 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:27.394904 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.394911 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.395809 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.395814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.396796 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.396808 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.397383 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.397387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.397507 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.398019 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:27.398040 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:27.400592 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:27.402923 (+ 2331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.402932 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.402938 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.403160 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.403545 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.403550 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.403554 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.403719 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.404373 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:27.404378 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:27.404490 (+ 112us) client_negotiation.cc:769] Sending connection context
0809 02:30:27.404633 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 02:30:27.404804 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":700,"spinlock_wait_cycles":7680,"thread_start_us":108,"threads_started":1}
I20260809 02:30:27.404997 22620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.392946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39980 (local address 127.21.214.190:45565)
0809 02:30:27.393072 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.393076 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.393881 (+ 805us) server_negotiation.cc:407] Connection header received
0809 02:30:27.394046 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.394049 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.394095 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.394179 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.395017 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.395670 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.396928 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.397281 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.397377 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.400733 (+ 3356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.400740 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.400746 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.400773 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.402553 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.403310 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.403314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.403315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.403401 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.403827 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.403831 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.403832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.404151 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.404230 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.404717 (+ 487us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.404840 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53,"spinlock_wait_cycles":1920}
I20260809 02:30:27.405122 22728 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } attempt: 3
I20260809 02:30:27.408066 22614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d: Bootstrap starting.
I20260809 02:30:27.408192 22855 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 02:30:27 dist-test-slave-68xk krb5kdc[22486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242627, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.189@KRBTEST.COM for kudu/127.21.214.188@KRBTEST.COM
I20260809 02:30:27.411113 22614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d: Neither blocks nor log segments found. Creating new log.
Aug 09 02:30:27 dist-test-slave-68xk krb5kdc[22486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:30:27.412067 22614 log.cc:824] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:30:27 dist-test-slave-68xk krb5kdc[22486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242627, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.188@KRBTEST.COM for kudu/127.21.214.189@KRBTEST.COM
I20260809 02:30:27.415375 22614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d: No bootstrap required, opened a new log
I20260809 02:30:27.415486 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.405535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:36038)
0809 02:30:27.405687 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.405704 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:27.405793 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:27.406258 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:27.406261 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:27.406493 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:27.406624 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.406634 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.407761 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.407764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.408501 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.408512 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.409156 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.409160 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.409248 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.409729 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:27.409744 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:27.411423 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:27.413374 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.413377 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.413379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.414082 (+ 703us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.414397 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.414400 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.414402 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.414533 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.414989 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:27.414992 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:27.415092 (+ 100us) client_negotiation.cc:769] Sending connection context
0809 02:30:27.415177 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 02:30:27.415312 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 02:30:27.416352 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.405934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36038 (local address 127.21.214.188:42075)
0809 02:30:27.406029 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.406033 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.406045 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:30:27.406080 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.406084 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.406124 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.406746 (+ 622us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.406836 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.407588 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.408665 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.409014 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.409468 (+ 454us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.411599 (+ 2131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.411603 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.411605 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.411630 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.413274 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.414199 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.414202 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.414204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.414292 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.414659 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.414662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.414663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.414868 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.415767 (+ 899us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.415840 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.415950 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:30:27.418355 22620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.405757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39990 (local address 127.21.214.190:45565)
0809 02:30:27.405935 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.405939 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.406096 (+ 157us) server_negotiation.cc:407] Connection header received
0809 02:30:27.406205 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.406208 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.406246 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.406319 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.407262 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.407937 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.409160 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.409491 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.409595 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.412766 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.412769 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.412772 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.412801 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.414741 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.415338 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.415341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.415343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.415490 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.416061 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.416064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.416066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.416317 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.417367 (+ 1050us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.418045 (+ 678us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.418181 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":80,"threads_started":1}
I20260809 02:30:27.419544 22614 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } }
I20260809 02:30:27.419759 22728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15: Bootstrap starting.
I20260809 02:30:27.419775 22614 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17564be3759a461b9806bf5643f82e5d, State: Initialized, Role: FOLLOWER
I20260809 02:30:27.420032 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.408839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48912 (local address 127.21.214.189:40385)
0809 02:30:27.408939 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.408943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.409081 (+ 138us) server_negotiation.cc:407] Connection header received
0809 02:30:27.409239 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.409242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.409292 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.409349 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.410506 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.411198 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.412796 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.413124 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.413230 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.415730 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.415733 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.415736 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.415766 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.417363 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.417877 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.417880 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.417882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.418082 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.418398 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.418402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.418404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.418955 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.419035 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.419753 (+ 718us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.419870 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 02:30:27.420091 22614 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } }
I20260809 02:30:27.420471 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.408619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:40385 (local address 127.0.0.1:48912)
0809 02:30:27.409017 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.409031 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:27.409138 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:27.409781 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:27.409786 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:27.409952 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:27.410322 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.410345 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.411349 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.411352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.412635 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.412651 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.413370 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.413373 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.413481 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.414102 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:27.414121 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:27.415580 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:27.417487 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.417490 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.417492 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.417758 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.418207 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.418210 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.418212 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.418292 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.419436 (+ 1144us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:27.419441 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:27.419542 (+ 101us) client_negotiation.cc:769] Sending connection context
0809 02:30:27.420168 (+ 626us) client_negotiation.cc:240] Negotiation successful
0809 02:30:27.420301 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339}
I20260809 02:30:27.420795 22867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } } }
I20260809 02:30:27.420956 22867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:30:27.421460 22614 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:27.422456 22728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:27.423453 22728 log.cc:824] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:27.425588 22728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15: No bootstrap required, opened a new log
W20260809 02:30:27.426726 22883 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:30:27.426879 22883 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 09 02:30:27 dist-test-slave-68xk krb5kdc[22486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.189@KRBTEST.COM
I20260809 02:30:27.429800 22728 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } }
I20260809 02:30:27.430020 22728 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39b88d91e719403184819c6d123c6b15, State: Initialized, Role: FOLLOWER
I20260809 02:30:27.430354 22728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } }
I20260809 02:30:27.430882 22887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } } }
I20260809 02:30:27.426937 22505 master_runner.cc:186] Error getting master registration for 127.21.214.189:40385: OK, instance_id { permanent_uuid: "39b88d91e719403184819c6d123c6b15" instance_seqno: 1786242627146280 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:30:27.431041 22887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:30:27.431093 22505 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:30:27.431180 22855 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:30:27.431679 22728 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:27.432794 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.422589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48924 (local address 127.21.214.189:40385)
0809 02:30:27.422933 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.422938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.422953 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:30:27.422988 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.422991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.423033 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.423951 (+ 918us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.424031 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.424705 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.425796 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.426093 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.426549 (+ 456us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.428819 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.428823 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.428826 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.428849 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.430361 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.430955 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.430959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.430961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.431045 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.431431 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.431434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.431435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.431688 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.431859 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.432516 (+ 657us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.432630 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270}
I20260809 02:30:27.436386 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
Aug 09 02:30:27 dist-test-slave-68xk krb5kdc[22486](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242627, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.188@KRBTEST.COM for kudu/127.21.214.188@KRBTEST.COM
I20260809 02:30:27.437801 22575 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "17564be3759a461b9806bf5643f82e5d"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39990
I20260809 02:30:27.438016 22575 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 02:30:27.438153 22575 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:27.439677 22575 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } }
I20260809 02:30:27.440819 22863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.431673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:42075 (local address 127.0.0.1:36054)
0809 02:30:27.431956 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:27.431974 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:27.432033 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:27.432333 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:27.432335 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:27.432513 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:27.432604 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.432612 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.433539 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.433541 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.434241 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:27.434250 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.434851 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.434854 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:27.434928 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.435501 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:27.435518 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:27.437066 (+ 1548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:27.439195 (+ 2129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.439198 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.439200 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.439434 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.439756 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:27.439759 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:27.439761 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:27.439843 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:27.440331 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:27.440334 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:27.440408 (+ 74us) client_negotiation.cc:769] Sending connection context
0809 02:30:27.440510 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 02:30:27.440651 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207}
I20260809 02:30:27.441156 22692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "17564be3759a461b9806bf5643f82e5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "39b88d91e719403184819c6d123c6b15"
I20260809 02:30:27.441397 22692 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:27.441615 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.431879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36054 (local address 127.21.214.188:42075)
0809 02:30:27.431998 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.432003 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.432021 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:30:27.432130 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.432135 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.432174 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.432242 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.432720 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.433426 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.434352 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.434661 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.434755 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.437203 (+ 2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.437206 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.437208 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.437233 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.439086 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.439545 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.439566 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.439567 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.439649 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.440010 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.440013 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.440015 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.440208 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.440299 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.441135 (+ 836us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.441251 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 02:30:27.438464 22624 master_runner.cc:186] Error getting master registration for 127.21.214.188:42075: OK, instance_id { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" instance_seqno: 1786242627380049 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:30:27.442523 22624 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:30:27.442646 22692 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17564be3759a461b9806bf5643f82e5d in term 1.
I20260809 02:30:27.443109 22528 leader_election.cc:302] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17564be3759a461b9806bf5643f82e5d, 39b88d91e719403184819c6d123c6b15; no voters:
I20260809 02:30:27.443373 22867 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:27.443608 22867 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [term 1 LEADER]: Becoming Leader. State: Replica: 17564be3759a461b9806bf5643f82e5d, State: Running, Role: LEADER
I20260809 02:30:27.443940 22867 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } }
I20260809 02:30:27.446090 22855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a: Bootstrap starting.
I20260809 02:30:27.446273 22905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17564be3759a461b9806bf5643f82e5d. Latest consensus state: current_term: 1 leader_uuid: "17564be3759a461b9806bf5643f82e5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } } }
I20260809 02:30:27.446383 22905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [sys.catalog]: This master's current role is: LEADER
W20260809 02:30:27.448091 22904 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:30:27.448171 22904 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:30:27.448144 22575 leader_election.cc:288] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [CANDIDATE]: Term 1 election: Requested vote from peers 39b88d91e719403184819c6d123c6b15 (127.21.214.189:40385), 3f5fa05f87ce4e33bd7cb1a3ae1e061a (127.21.214.188:42075)
I20260809 02:30:27.449676 22855 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:27.450665 22855 log.cc:824] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:27.451421 22911 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:27.453047 22855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a: No bootstrap required, opened a new log
I20260809 02:30:27.457275 22855 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } }
I20260809 02:30:27.457541 22855 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f5fa05f87ce4e33bd7cb1a3ae1e061a, State: Initialized, Role: FOLLOWER
I20260809 02:30:27.457880 22855 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } }
I20260809 02:30:27.458488 22919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } } }
I20260809 02:30:27.458765 22919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:30:27.459393 22855 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:27.459439 22816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "17564be3759a461b9806bf5643f82e5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a"
I20260809 02:30:27.459661 22816 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:27.461714 22816 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17564be3759a461b9806bf5643f82e5d in term 1.
I20260809 02:30:27.462462 22911 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:27.468499 22816 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a [term 1 FOLLOWER]: Refusing update from remote peer 17564be3759a461b9806bf5643f82e5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:30:27.469476 22692 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15 [term 1 FOLLOWER]: Refusing update from remote peer 17564be3759a461b9806bf5643f82e5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:30:27.470319 22905 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 02:30:27.473600 22955 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:30:27.473676 22955 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:30:27.475224 22905 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:30:27.480005 22620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.462949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39994 (local address 127.21.214.190:45565)
0809 02:30:27.463069 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.463074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.466575 (+ 3501us) server_negotiation.cc:407] Connection header received
0809 02:30:27.466780 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.466783 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.466849 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.466905 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.471785 (+ 4880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.472510 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.473711 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.474103 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.474188 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.476169 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.476173 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.476176 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.476202 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.478005 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.478593 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.478596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.478598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.478690 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.479011 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.479015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.479017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.479230 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.479357 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.479725 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.479847 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 02:30:27.481025 22887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17564be3759a461b9806bf5643f82e5d. Latest consensus state: current_term: 1 leader_uuid: "17564be3759a461b9806bf5643f82e5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } } }
I20260809 02:30:27.481165 22887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:30:27.483629 22919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17564be3759a461b9806bf5643f82e5d. Latest consensus state: current_term: 1 leader_uuid: "17564be3759a461b9806bf5643f82e5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } } }
I20260809 02:30:27.483810 22919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:30:27.490378 22862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.464863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36060 (local address 127.21.214.188:42075)
0809 02:30:27.464966 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.464970 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.473974 (+ 9004us) server_negotiation.cc:407] Connection header received
0809 02:30:27.474130 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.474133 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.474175 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.474222 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.478197 (+ 3975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.478990 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.480134 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.480474 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.480551 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.482299 (+ 1748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.482303 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.482306 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.482332 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.484177 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.488888 (+ 4711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.488892 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.488894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.488995 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.489349 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.489353 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.489355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.489604 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.489725 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.490107 (+ 382us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.490233 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 02:30:27.495185 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:27.463376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48928 (local address 127.21.214.189:40385)
0809 02:30:27.463491 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.463495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.470806 (+ 7311us) server_negotiation.cc:407] Connection header received
0809 02:30:27.470854 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.470859 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.470915 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.470998 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.484981 (+ 13983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.485725 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.486819 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:27.487129 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:27.487209 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:27.491277 (+ 4068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:27.491281 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:27.491283 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:27.491314 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:27.493105 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.493643 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.493646 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.493648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.493745 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:27.494080 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:27.494084 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:27.494087 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:27.494316 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:27.494484 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:27.494883 (+ 399us) server_negotiation.cc:299] Negotiation successful
0809 02:30:27.495026 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 02:30:27.495261 22919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "17564be3759a461b9806bf5643f82e5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } } }
I20260809 02:30:27.495365 22919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:30:27.495805 22905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "17564be3759a461b9806bf5643f82e5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } } }
I20260809 02:30:27.495937 22905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:27.496335 22952 mvcc.cc:205] Tried to move back new op lower bound from 7316449802102521856 to 7316449802014068736. Current Snapshot: MvccSnapshot[applied={T|T < 7316449802102521856}]
I20260809 02:30:27.496960 22959 mvcc.cc:205] Tried to move back new op lower bound from 7316449802102521856 to 7316449802014068736. Current Snapshot: MvccSnapshot[applied={T|T < 7316449802102521856}]
I20260809 02:30:27.497457 22905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "17564be3759a461b9806bf5643f82e5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } } }
I20260809 02:30:27.497565 22905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:27.499085 22887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "17564be3759a461b9806bf5643f82e5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17564be3759a461b9806bf5643f82e5d" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 45565 } } peers { permanent_uuid: "39b88d91e719403184819c6d123c6b15" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 40385 } } peers { permanent_uuid: "3f5fa05f87ce4e33bd7cb1a3ae1e061a" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 42075 } } }
I20260809 02:30:27.499205 22887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:30:27.501106 22958 mvcc.cc:205] Tried to move back new op lower bound from 7316449802102521856 to 7316449802014068736. Current Snapshot: MvccSnapshot[applied={T|T < 7316449802102521856 or (T in {7316449802102521856})}]
I20260809 02:30:27.502604 22911 catalog_manager.cc:1347] Generated new cluster ID: ea3b059716164c57be59fac332606bba
I20260809 02:30:27.502667 22911 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:27.545284 22911 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:27.546728 22911 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:27.565824 22911 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17564be3759a461b9806bf5643f82e5d: Generated new TSK 0
I20260809 02:30:27.566814 22911 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:30:27.607167 22862 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:27.603861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36072 (local address 127.21.214.188:42075)
0809 02:30:27.603985 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.603990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.605983 (+ 1993us) server_negotiation.cc:407] Connection header received
0809 02:30:27.606187 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.606190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.606242 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.606299 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.607019 (+ 720us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36072: BlockingRecv error: recv got EOF from 127.0.0.1:36072 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 02:30:27.608911 22620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:27.604662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40000 (local address 127.21.214.190:45565)
0809 02:30:27.604779 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.604783 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.607696 (+ 2913us) server_negotiation.cc:407] Connection header received
0809 02:30:27.608081 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.608084 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.608134 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.608184 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.608789 (+ 605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40000: BlockingRecv error: recv got EOF from 127.0.0.1:40000 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 02:30:27.609948 22734 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:27.605352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48930 (local address 127.21.214.189:40385)
0809 02:30:27.605467 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.605471 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.607903 (+ 2432us) server_negotiation.cc:407] Connection header received
0809 02:30:27.609180 (+ 1277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.609184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.609237 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.609290 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.609828 (+ 538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48930: BlockingRecv error: recv got EOF from 127.0.0.1:48930 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 02:30:27.614614 22734 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:27.613135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48936 (local address 127.21.214.189:40385)
0809 02:30:27.613236 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.613239 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.613689 (+ 450us) server_negotiation.cc:407] Connection header received
0809 02:30:27.613900 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.613903 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.613974 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.614025 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.614507 (+ 482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48936: BlockingRecv error: recv got EOF from 127.0.0.1:48936 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 02:30:27.619660 22734 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:27.618102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48952 (local address 127.21.214.189:40385)
0809 02:30:27.618199 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.618203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.618795 (+ 592us) server_negotiation.cc:407] Connection header received
0809 02:30:27.618972 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.618975 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.619020 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.619072 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.619560 (+ 488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48952: BlockingRecv error: recv got EOF from 127.0.0.1:48952 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 02:30:27.625308 22734 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:27.623855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48958 (local address 127.21.214.189:40385)
0809 02:30:27.623948 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.623952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.624445 (+ 493us) server_negotiation.cc:407] Connection header received
0809 02:30:27.624629 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.624632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.624675 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.624723 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.625215 (+ 492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48958: BlockingRecv error: recv got EOF from 127.0.0.1:48958 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 02:30:27.633033 22734 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:27.631487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48970 (local address 127.21.214.189:40385)
0809 02:30:27.631632 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.631635 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.632144 (+ 509us) server_negotiation.cc:407] Connection header received
0809 02:30:27.632327 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.632330 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.632379 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.632428 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.632934 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48970: BlockingRecv error: recv got EOF from 127.0.0.1:48970 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260809 02:30:27.645211 22734 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:27.643519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48982 (local address 127.21.214.189:40385)
0809 02:30:27.643649 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.643655 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.644179 (+ 524us) server_negotiation.cc:407] Connection header received
0809 02:30:27.644388 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.644392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.644445 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.644501 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.645098 (+ 597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48982: BlockingRecv error: recv got EOF from 127.0.0.1:48982 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 02:30:27.665642 22734 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:27.664008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48990 (local address 127.21.214.189:40385)
0809 02:30:27.664139 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.664146 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.664714 (+ 568us) server_negotiation.cc:407] Connection header received
0809 02:30:27.664810 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.664813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.664874 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.664973 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.665508 (+ 535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48990: BlockingRecv error: recv got EOF from 127.0.0.1:48990 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260809 02:30:27.701570 22734 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:27.700202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48992 (local address 127.21.214.189:40385)
0809 02:30:27.700418 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.700423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.700602 (+ 179us) server_negotiation.cc:407] Connection header received
0809 02:30:27.700782 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.700785 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.700844 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.700940 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.701453 (+ 513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48992: BlockingRecv error: recv got EOF from 127.0.0.1:48992 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
W20260809 02:30:27.769308 22734 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:27.767984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48996 (local address 127.21.214.189:40385)
0809 02:30:27.768167 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.768172 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.768342 (+ 170us) server_negotiation.cc:407] Connection header received
0809 02:30:27.768523 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.768526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.768581 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.768675 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.769190 (+ 515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48996: BlockingRecv error: recv got EOF from 127.0.0.1:48996 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260809 02:30:27.900849 22734 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:27.899596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49000 (local address 127.21.214.189:40385)
0809 02:30:27.899766 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:27.899771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:27.899914 (+ 143us) server_negotiation.cc:407] Connection header received
0809 02:30:27.900092 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:27.900096 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:27.900149 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:27.900267 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:27.900734 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49000: BlockingRecv error: recv got EOF from 127.0.0.1:49000 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 02:30:28.160476 22734 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:28.159100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49006 (local address 127.21.214.189:40385)
0809 02:30:28.159235 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:28.159242 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:28.159505 (+ 263us) server_negotiation.cc:407] Connection header received
0809 02:30:28.159675 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:28.159683 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:28.159731 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:28.159825 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:28.160308 (+ 483us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49006: BlockingRecv error: recv got EOF from 127.0.0.1:49006 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:30:28.449537 22904 catalog_manager.cc:1259] Loaded cluster ID: ea3b059716164c57be59fac332606bba
I20260809 02:30:28.449636 22904 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15: loading cluster ID for follower catalog manager: success
I20260809 02:30:28.451565 22904 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15: acquiring CA information for follower catalog manager: success
I20260809 02:30:28.452854 22904 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 39b88d91e719403184819c6d123c6b15: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:30:28.475085 22955 catalog_manager.cc:1259] Loaded cluster ID: ea3b059716164c57be59fac332606bba
I20260809 02:30:28.475176 22955 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a: loading cluster ID for follower catalog manager: success
I20260809 02:30:28.476836 22955 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a: acquiring CA information for follower catalog manager: success
I20260809 02:30:28.477936 22955 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3f5fa05f87ce4e33bd7cb1a3ae1e061a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:30:28.678893 23070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:28.675059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49016 (local address 127.21.214.189:40385)
0809 02:30:28.675312 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:28.675316 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:28.675334 (+ 18us) server_negotiation.cc:407] Connection header received
0809 02:30:28.675487 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:28.675490 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:28.675624 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:28.675749 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:30:28.676035 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:28.676557 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:28.677444 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:28.677670 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:28.677755 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:28.678043 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:30:28.678555 (+ 512us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:30:28.678652 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:28.678706 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 02:30:28.678765 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":101,"threads_started":1}
I20260809 02:30:28.686339 23078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:28.682286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36088 (local address 127.21.214.188:42075)
0809 02:30:28.682620 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:28.682624 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:28.682638 (+ 14us) server_negotiation.cc:407] Connection header received
0809 02:30:28.682724 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:28.682726 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:28.682842 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:28.682949 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:30:28.683223 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:28.683803 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:28.684724 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:28.684991 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:28.685112 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:28.685427 (+ 315us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:30:28.685856 (+ 429us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:30:28.685955 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:28.686066 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 02:30:28.686150 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":74,"threads_started":1}
I20260809 02:30:28.693174 23078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:28.689540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36090 (local address 127.21.214.188:42075)
0809 02:30:28.689910 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:28.689914 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:28.689929 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:30:28.689971 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:28.689973 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:28.690011 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:28.690074 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:30:28.690348 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:28.691080 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:28.692001 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:28.692330 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:28.692433 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:28.692725 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:30:28.692797 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:30:28.692882 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:28.692972 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 02:30:28.693021 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 02:30:28.693941 23070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:28.689810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49024 (local address 127.21.214.189:40385)
0809 02:30:28.689962 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:28.689967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:28.690370 (+ 403us) server_negotiation.cc:407] Connection header received
0809 02:30:28.690506 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:28.690509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:28.690559 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:28.690640 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:30:28.690877 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:28.691623 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:28.692576 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:28.692909 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:28.693013 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:28.693469 (+ 456us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:30:28.693550 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:30:28.693597 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:28.693770 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 02:30:28.693827 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 02:30:28.694916 23092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:28.689957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40002 (local address 127.21.214.190:45565)
0809 02:30:28.690272 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:28.690276 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:28.690312 (+ 36us) server_negotiation.cc:407] Connection header received
0809 02:30:28.690407 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:28.690410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:28.690590 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:28.690730 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:30:28.691076 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:28.691841 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:28.693033 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:28.693385 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:28.693475 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:28.693893 (+ 418us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:30:28.694229 (+ 336us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:30:28.694660 (+ 431us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:28.694695 (+ 35us) server_negotiation.cc:299] Negotiation successful
0809 02:30:28.694768 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":114,"threads_started":1}
I20260809 02:30:28.698117 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 22505
I20260809 02:30:28.712981 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 22624
I20260809 02:30:28.723642 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 22738
2026-08-09T02:30:28Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3410 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 02:30:28 dist-test-slave-68xk krb5kdc[23096](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 02:30:28 dist-test-slave-68xk krb5kdc[23096](info): set up 2 sockets
Aug 09 02:30:28 dist-test-slave-68xk krb5kdc[23096](info): commencing operation
krb5kdc: starting...
W20260809 02:30:30.036916 22362 mini_kdc.cc:121] Time spent starting KDC: real 1.284s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/test-user.keytab.
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T02:30:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T02:30:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.21.214.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
Entry for principal kudu/127.21.214.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab.
I20260809 02:30:30.177356 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:44595
--webserver_interface=127.21.214.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:41437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:44595,127.21.214.189:44279,127.21.214.188:44167
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 02:30:30.291646 23118 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:30:30.291935 23118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:30.291960 23118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:30.291998 23118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:30.295974 23118 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:30.296032 23118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:30.296052 23118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:30.296069 23118 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:30.296084 23118 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:30.301366 23118 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:44595,127.21.214.189:44279,127.21.214.188:44167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.190.keytab
--principal=kudu/127.21.214.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.190:44595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.21.214.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:30.302388 23118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:30.303483 23118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:30.313102 23125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:30.313313 23131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:30.313380 23126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:30.313470 23118 server_base.cc:1034] running on GCE node
I20260809 02:30:30.314203 23118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:30.315425 23118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:30.316680 23118 hybrid_clock.cc:648] HybridClock initialized: now 1786242630316665 us; error 39 us; skew 500 ppm
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:30.325435 23118 init.cc:377] Logged in from keytab as kudu/127.21.214.190@KRBTEST.COM (short username kudu)
I20260809 02:30:30.326570 23118 webserver.cc:460] Webserver started at http://127.21.214.190:45467/ using document root <none> and password file <none>
I20260809 02:30:30.327168 23118 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:30.327239 23118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:30.327421 23118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:30.329615 23118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/data/instance:
uuid: "e9ac850678314b0fbfb09915980be710"
format_stamp: "Formatted at 2026-08-09 02:30:30 on dist-test-slave-68xk"
server_key: "f49db22161e9ac143c6b21cea09e2906"
server_key_iv: "d2660554a8daf6a7331b366ebfab8175"
server_key_version: "encryptionkey@0"
I20260809 02:30:30.330207 23118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/wal/instance:
uuid: "e9ac850678314b0fbfb09915980be710"
format_stamp: "Formatted at 2026-08-09 02:30:30 on dist-test-slave-68xk"
server_key: "f49db22161e9ac143c6b21cea09e2906"
server_key_iv: "d2660554a8daf6a7331b366ebfab8175"
server_key_version: "encryptionkey@0"
I20260809 02:30:30.334304 23118 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260809 02:30:30.337039 23140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:30.338495 23118 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 02:30:30.338646 23118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/wal
uuid: "e9ac850678314b0fbfb09915980be710"
format_stamp: "Formatted at 2026-08-09 02:30:30 on dist-test-slave-68xk"
server_key: "f49db22161e9ac143c6b21cea09e2906"
server_key_iv: "d2660554a8daf6a7331b366ebfab8175"
server_key_version: "encryptionkey@0"
I20260809 02:30:30.338758 23118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:30.353933 23118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:30.357363 23118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:30.357577 23118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:30.365018 23118 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.190:44595
I20260809 02:30:30.365353 23232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.190:44595 every 8 connection(s)
I20260809 02:30:30.366024 23118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/data/info.pb
I20260809 02:30:30.368943 23235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:30.372746 23235 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:30:30.374519 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 23118
I20260809 02:30:30.374709 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-0/wal/instance
I20260809 02:30:30.375058 22362 external_mini_cluster.cc:1428] Setting key deb7980b4bc3863e16410be48ab4032c
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.21.214.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.189@KRBTEST.COM" created.
I20260809 02:30:30.389009 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.375290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44595 (local address 127.0.0.1:55430)
0809 02:30:30.375955 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.376029 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:30.377121 (+ 1092us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:30.377852 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:30.377858 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:30.378337 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:30.378665 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.378680 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.379875 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.379878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.380626 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.380636 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.381310 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.381314 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.381418 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.382092 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:30.382110 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:30.383711 (+ 1601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:30.386056 (+ 2345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.386066 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.386076 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.386312 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.386695 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.386698 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.386700 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.386896 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.387541 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:30.387546 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:30.387679 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 02:30:30.387821 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 02:30:30.388076 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"spinlock_wait_cycles":1280,"thread_start_us":266,"threads_started":1}
I20260809 02:30:30.389016 23239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.375289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55430 (local address 127.21.214.190:44595)
0809 02:30:30.375746 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.375768 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.376157 (+ 389us) server_negotiation.cc:407] Connection header received
0809 02:30:30.377448 (+ 1291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.377453 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.377651 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.377852 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.378845 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.379737 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.380760 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.381144 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.381322 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.383870 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.383883 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.383892 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.383914 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.385939 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.386455 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.386461 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.386462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.386575 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.387017 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.387020 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.387021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.387412 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.387530 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.387930 (+ 400us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.388198 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":99,"server-negotiator.queue_time_us":305,"thread_start_us":152,"threads_started":1}
I20260809 02:30:30.392776 23235 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:30:30.393527 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.393257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:44279 (local address 127.0.0.1:36556)
0809 02:30:30.393393 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.393470 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:44279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 02:30:30.393769 23141 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.214.189:44279: connect: Connection refused (error 111)
I20260809 02:30:30.394722 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.394480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:44279 (local address 127.0.0.1:36568)
0809 02:30:30.394572 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.394642 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:44279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260809 02:30:30.394892 23235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.189:44279: Network error: Client connection negotiation failed: client connection to 127.21.214.189:44279: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.189.keytab.
Entry for principal kudu/127.21.214.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.189.keytab.
I20260809 02:30:30.406698 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.189:44279
--webserver_interface=127.21.214.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.189.keytab
--principal=kudu/127.21.214.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:41437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:44595,127.21.214.189:44279,127.21.214.188:44167
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:30:30.444162 23235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } attempt: 1
I20260809 02:30:30.445138 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.444754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:44279 (local address 127.0.0.1:36574)
0809 02:30:30.444946 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.445021 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:44279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 02:30:30.445969 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.445713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:44279 (local address 127.0.0.1:36578)
0809 02:30:30.445842 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.445901 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:44279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 02:30:30.446244 23235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.189:44279: Network error: Client connection negotiation failed: client connection to 127.21.214.189:44279: connect: Connection refused (error 111)
I20260809 02:30:30.514472 23235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } attempt: 2
I20260809 02:30:30.515419 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.515063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:44279 (local address 127.0.0.1:36582)
0809 02:30:30.515253 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.515327 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:44279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 02:30:30.516296 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.516032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:44279 (local address 127.0.0.1:36590)
0809 02:30:30.516181 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.516233 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.189:44279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260809 02:30:30.516503 23235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.189:44279: Network error: Client connection negotiation failed: client connection to 127.21.214.189:44279: connect: Connection refused (error 111)
W20260809 02:30:30.520704 23246 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:30:30.520989 23246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:30.521046 23246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:30.521178 23246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 02:30:30.525249 23246 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:30.525298 23246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:30.525317 23246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:30.525334 23246 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:30.525398 23246 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:30.530707 23246 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:44595,127.21.214.189:44279,127.21.214.188:44167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.189.keytab
--principal=kudu/127.21.214.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.189:44279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.21.214.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:30.531733 23246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:30.532763 23246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:30.541489 23253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:30.541621 23246 server_base.cc:1034] running on GCE node
W20260809 02:30:30.541574 23259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:30.541837 23254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:30.542526 23246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:30.543733 23246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:30.544945 23246 hybrid_clock.cc:648] HybridClock initialized: now 1786242630544924 us; error 37 us; skew 500 ppm
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:30.548017 23246 init.cc:377] Logged in from keytab as kudu/127.21.214.189@KRBTEST.COM (short username kudu)
I20260809 02:30:30.548998 23246 webserver.cc:460] Webserver started at http://127.21.214.189:37961/ using document root <none> and password file <none>
I20260809 02:30:30.549638 23246 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:30.549762 23246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:30.550035 23246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:30.552487 23246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/data/instance:
uuid: "34caf53f93fa4144af4bf57106193245"
format_stamp: "Formatted at 2026-08-09 02:30:30 on dist-test-slave-68xk"
server_key: "d18ea043f949d90637ac1c691ad3c51f"
server_key_iv: "c7d013d76b2d1d9e48c0a9a9d399ada9"
server_key_version: "encryptionkey@0"
I20260809 02:30:30.553256 23246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/wal/instance:
uuid: "34caf53f93fa4144af4bf57106193245"
format_stamp: "Formatted at 2026-08-09 02:30:30 on dist-test-slave-68xk"
server_key: "d18ea043f949d90637ac1c691ad3c51f"
server_key_iv: "c7d013d76b2d1d9e48c0a9a9d399ada9"
server_key_version: "encryptionkey@0"
I20260809 02:30:30.557353 23246 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 02:30:30.559965 23271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:30.561185 23246 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 02:30:30.561412 23246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/wal
uuid: "34caf53f93fa4144af4bf57106193245"
format_stamp: "Formatted at 2026-08-09 02:30:30 on dist-test-slave-68xk"
server_key: "d18ea043f949d90637ac1c691ad3c51f"
server_key_iv: "c7d013d76b2d1d9e48c0a9a9d399ada9"
server_key_version: "encryptionkey@0"
I20260809 02:30:30.561540 23246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:30.587977 23246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:30.591699 23246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:30.591948 23246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:30.599547 23246 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.189:44279
I20260809 02:30:30.599856 23359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.189:44279 every 8 connection(s)
I20260809 02:30:30.600605 23246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/data/info.pb
I20260809 02:30:30.603631 23362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:30.603711 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 23246
I20260809 02:30:30.603847 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-1/wal/instance
I20260809 02:30:30.604171 22362 external_mini_cluster.cc:1428] Setting key fba48a69d363f32c1d86364330f9ef35
I20260809 02:30:30.607781 23235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } attempt: 3
I20260809 02:30:30.608577 23362 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.21.214.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.21.214.188@KRBTEST.COM" created.
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for kudu/127.21.214.189@KRBTEST.COM
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.189@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:30:30.623943 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.608379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:44279 (local address 127.0.0.1:36598)
0809 02:30:30.608620 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.608638 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:30.608752 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:30.611291 (+ 2539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:30.611294 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:30.611511 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:30.611662 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.611669 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.613583 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.613589 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.614571 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.614585 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.615291 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.615294 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.615399 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.616011 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:30.616023 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:30.618844 (+ 2821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:30.621416 (+ 2572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.621421 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.621424 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.621794 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.622251 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.622257 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.622262 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.622368 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.623260 (+ 892us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:30.623263 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:30.623426 (+ 163us) client_negotiation.cc:769] Sending connection context
0809 02:30:30.623573 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 02:30:30.623754 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":31}
I20260809 02:30:30.624408 23239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.610946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55442 (local address 127.21.214.190:44595)
0809 02:30:30.611090 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.611097 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.611552 (+ 455us) server_negotiation.cc:407] Connection header received
0809 02:30:30.611781 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.611787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.611841 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.611917 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.612934 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.613688 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.614805 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.615645 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.615733 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.619945 (+ 4212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.619951 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.619956 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.619983 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.622007 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.622614 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.622620 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.622625 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.622709 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.623043 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.623049 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.623053 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.623352 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.623452 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.624016 (+ 564us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.624161 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":53}
I20260809 02:30:30.625336 23365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.609188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36598 (local address 127.21.214.189:44279)
0809 02:30:30.609684 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.609705 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.609768 (+ 63us) server_negotiation.cc:407] Connection header received
0809 02:30:30.610490 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.610515 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.610967 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.611877 (+ 910us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.612247 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.613439 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.614711 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.615133 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.615336 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.619005 (+ 3669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.619013 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.619031 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.619053 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.621275 (+ 2222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.621934 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.621941 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.621956 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.622130 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.622501 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.622505 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.622507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.623133 (+ 626us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.623299 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.623731 (+ 432us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.624278 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":156,"threads_started":1}
I20260809 02:30:30.625339 23367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.610856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44595 (local address 127.0.0.1:55442)
0809 02:30:30.611397 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.611458 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:30.611655 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:30.612007 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:30.612015 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:30.612503 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:30.612759 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.612776 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.613823 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.613827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.614659 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.614675 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.615889 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.615895 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.616010 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.616563 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:30.616580 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:30.619794 (+ 3214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:30.622130 (+ 2336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.622139 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.622147 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.622492 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.622820 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.622823 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.622825 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.622921 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.623514 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:30.623523 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:30.623724 (+ 201us) client_negotiation.cc:769] Sending connection context
0809 02:30:30.624611 (+ 887us) client_negotiation.cc:240] Negotiation successful
0809 02:30:30.624830 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":122,"threads_started":1}
I20260809 02:30:30.626986 23362 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:30:30.627988 23235 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:30:30.628770 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.628487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47270)
0809 02:30:30.628615 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.628682 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 02:30:30.629575 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.629297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47276)
0809 02:30:30.629460 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.629518 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260809 02:30:30.629829 23235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:44167: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.189@KRBTEST.COM for kudu/127.21.214.189@KRBTEST.COM
I20260809 02:30:30.637495 23367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.627590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:44279 (local address 127.0.0.1:36612)
0809 02:30:30.627777 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.627794 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:30.627877 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:30.628356 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:30.628361 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:30.628550 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:30.628693 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.628704 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.629824 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.629828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.630596 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.630618 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.631064 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.631067 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.631144 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.631835 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:30.631847 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:30.633207 (+ 1360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:30.635650 (+ 2443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.635653 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.635654 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.636065 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.636410 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.636412 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.636413 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.636498 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.636959 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:30.636962 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:30.637045 (+ 83us) client_negotiation.cc:769] Sending connection context
0809 02:30:30.637172 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 02:30:30.637370 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260809 02:30:30.637666 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.627715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36612 (local address 127.21.214.189:44279)
0809 02:30:30.628089 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.628103 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.628119 (+ 16us) server_negotiation.cc:407] Connection header received
0809 02:30:30.628156 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.628160 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.628208 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.628312 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.628850 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.629656 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.630725 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.630958 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.631044 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.633355 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.633358 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.633360 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.633382 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.635523 (+ 2141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.636201 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.636204 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.636205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.636313 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.636646 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.636651 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.636655 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.636866 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.636949 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.637265 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.637452 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":296,"thread_start_us":122,"threads_started":1}
I20260809 02:30:30.638494 23362 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.21.214.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.188.keytab.
Entry for principal kudu/127.21.214.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.188.keytab.
I20260809 02:30:30.639389 23367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.639043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47278)
0809 02:30:30.639228 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.639326 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 02:30:30.639627 23277 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
I20260809 02:30:30.640290 22362 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskplQfV_/build/debug/bin/kudu
/tmp/dist-test-taskplQfV_/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.188:44167
--webserver_interface=127.21.214.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.188.keytab
--principal=kudu/127.21.214.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.21.214.148:41437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.21.214.190:44595,127.21.214.189:44279,127.21.214.188:44167
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 02:30:30.640748 23367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.640498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47280)
0809 02:30:30.640637 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.640697 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260809 02:30:30.640902 23362 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:44167: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
I20260809 02:30:30.661038 23235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } attempt: 1
I20260809 02:30:30.661969 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.661644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47288)
0809 02:30:30.661818 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.661885 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 02:30:30.662859 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.662623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47290)
0809 02:30:30.662747 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.662805 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 02:30:30.663008 23235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:44167: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
I20260809 02:30:30.690212 23362 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } attempt: 1
I20260809 02:30:30.691237 23367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.690877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47300)
0809 02:30:30.691055 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.691123 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 02:30:30.692034 23367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.691805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47314)
0809 02:30:30.691922 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.691978 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 02:30:30.692173 23362 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:44167: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
I20260809 02:30:30.738197 23235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } attempt: 2
I20260809 02:30:30.739113 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.738801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47326)
0809 02:30:30.738963 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.739035 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 02:30:30.739885 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.739643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47328)
0809 02:30:30.739777 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.739832 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260809 02:30:30.740025 23235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:44167: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
W20260809 02:30:30.757592 23377 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 02:30:30.757927 23377 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 02:30:30.758002 23377 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 02:30:30.758080 23377 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 02:30:30.760346 23362 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } attempt: 2
I20260809 02:30:30.761232 23367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.760893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47334)
0809 02:30:30.761076 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.761155 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 02:30:30.762094 23367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.761839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47346)
0809 02:30:30.761976 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.762034 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260809 02:30:30.762238 23362 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.21.214.188:44167: Network error: Client connection negotiation failed: client connection to 127.21.214.188:44167: connect: Connection refused (error 111)
W20260809 02:30:30.762477 23377 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 02:30:30.762539 23377 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 02:30:30.762583 23377 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 02:30:30.762619 23377 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 02:30:30.762655 23377 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 02:30:30.768425 23377 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.21.214.148:41437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.21.214.190:44595,127.21.214.189:44279,127.21.214.188:44167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/krb5kdc/kudu_127.21.214.188.keytab
--principal=kudu/127.21.214.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.21.214.188:44167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.21.214.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23377
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 09 Aug 2026 01:42:25 UTC on ccycloud.quasar-erdzyp.root.comops.site
build id 4575767
I20260809 02:30:30.769608 23377 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 02:30:30.770777 23377 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 02:30:30.779412 23385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 02:30:30.779413 23384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:30.779615 23377 server_base.cc:1034] running on GCE node
W20260809 02:30:30.779472 23390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 02:30:30.780341 23377 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 02:30:30.781457 23377 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 02:30:30.782665 23377 hybrid_clock.cc:648] HybridClock initialized: now 1786242630782643 us; error 32 us; skew 500 ppm
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 02:30:30.785519 23377 init.cc:377] Logged in from keytab as kudu/127.21.214.188@KRBTEST.COM (short username kudu)
I20260809 02:30:30.786463 23377 webserver.cc:460] Webserver started at http://127.21.214.188:45045/ using document root <none> and password file <none>
I20260809 02:30:30.787048 23377 fs_manager.cc:359] Metadata directory not provided
I20260809 02:30:30.787147 23377 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 02:30:30.787398 23377 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 02:30:30.789485 23377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/data/instance:
uuid: "9865d382654b40bcb26239fbe19463c8"
format_stamp: "Formatted at 2026-08-09 02:30:30 on dist-test-slave-68xk"
server_key: "f1394fb84d02e3afe0c32bfdf561629e"
server_key_iv: "f68ed64484dc8078f6dffc8132f4e7e8"
server_key_version: "encryptionkey@0"
I20260809 02:30:30.790086 23377 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/wal/instance:
uuid: "9865d382654b40bcb26239fbe19463c8"
format_stamp: "Formatted at 2026-08-09 02:30:30 on dist-test-slave-68xk"
server_key: "f1394fb84d02e3afe0c32bfdf561629e"
server_key_iv: "f68ed64484dc8078f6dffc8132f4e7e8"
server_key_version: "encryptionkey@0"
I20260809 02:30:30.793912 23377 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 02:30:30.796514 23398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 02:30:30.797829 23377 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 02:30:30.797978 23377 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/data,/tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/wal
uuid: "9865d382654b40bcb26239fbe19463c8"
format_stamp: "Formatted at 2026-08-09 02:30:30 on dist-test-slave-68xk"
server_key: "f1394fb84d02e3afe0c32bfdf561629e"
server_key_iv: "f68ed64484dc8078f6dffc8132f4e7e8"
server_key_version: "encryptionkey@0"
I20260809 02:30:30.798094 23377 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 02:30:30.814260 23377 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 02:30:30.817488 23377 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 02:30:30.817727 23377 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 02:30:30.825418 23377 rpc_server.cc:307] RPC server started. Bound to: 127.21.214.188:44167
I20260809 02:30:30.825786 23483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.21.214.188:44167 every 8 connection(s)
I20260809 02:30:30.826542 23377 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/data/info.pb
I20260809 02:30:30.828081 22362 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskplQfV_/build/debug/bin/kudu as pid 23377
I20260809 02:30:30.828387 22362 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskplQfV_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786242328272206-22362-0/minicluster-data/master-2/wal/instance
I20260809 02:30:30.828801 22362 external_mini_cluster.cc:1428] Setting key db1365926728c985cae901d7df4b48b4
I20260809 02:30:30.830152 23487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 02:30:30.835050 23487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:30:30.839208 23235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } attempt: 3
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.188@KRBTEST.COM
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.188@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.190@KRBTEST.COM for kudu/127.21.214.188@KRBTEST.COM
I20260809 02:30:30.847144 23490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.830304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47358 (local address 127.21.214.188:44167)
0809 02:30:30.830984 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.831001 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.831042 (+ 41us) server_negotiation.cc:407] Connection header received
0809 02:30:30.831882 (+ 840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.831899 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.832262 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.832557 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.833640 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.834869 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.836157 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.836632 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.836826 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.840166 (+ 3340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.840172 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.840181 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.840208 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.842717 (+ 2509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.843385 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.843392 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.843397 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.843570 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.843901 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.843908 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.843915 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.844507 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.844781 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.845324 (+ 543us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.845640 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":200,"threads_started":1}
I20260809 02:30:30.848918 23239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.837303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55448 (local address 127.21.214.190:44595)
0809 02:30:30.837469 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.837474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.837718 (+ 244us) server_negotiation.cc:407] Connection header received
0809 02:30:30.837882 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.837887 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.837949 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.838055 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.838821 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.839477 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.840888 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.841281 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.841379 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.844131 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.844134 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.844137 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.844162 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.845918 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.846833 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.846836 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.846838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.846928 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.847768 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.847772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.847774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.848020 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.848144 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.848627 (+ 483us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.848735 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 02:30:30.849689 23492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.837196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.190:44595 (local address 127.0.0.1:55448)
0809 02:30:30.837555 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.837605 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:30.837748 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:30.838108 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:30.838112 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:30.838535 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:30.838670 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.838677 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.839631 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.839635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.840760 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.840773 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.841498 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.841502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.841626 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.842142 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:30.842158 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:30.843983 (+ 1825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:30.846041 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.846051 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.846057 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.846715 (+ 658us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.847061 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.847064 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.847066 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.847164 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.848145 (+ 981us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:30.848153 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:30.848292 (+ 139us) client_negotiation.cc:769] Sending connection context
0809 02:30:30.848450 (+ 158us) client_negotiation.cc:240] Negotiation successful
0809 02:30:30.849503 (+ 1053us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":118,"threads_started":1}
I20260809 02:30:30.849990 23240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.839635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47372)
0809 02:30:30.839833 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.839846 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:30.839928 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:30.840394 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:30.840399 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:30.840587 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:30.840666 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.840671 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.842119 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.842123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.842992 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.843006 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.843638 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.843642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.843745 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.844234 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:30.844246 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:30.845808 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:30.848258 (+ 2450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.848261 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.848263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.848514 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.848846 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.848849 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.848851 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.848943 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.849472 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:30.849476 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:30.849574 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 02:30:30.849692 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 02:30:30.849849 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130}
I20260809 02:30:30.850054 23494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.839772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47372 (local address 127.21.214.188:44167)
0809 02:30:30.840123 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.840135 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.840150 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:30:30.840187 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.840190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.840246 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.840342 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.841196 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.841958 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.843149 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.843489 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.843964 (+ 475us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.845959 (+ 1995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.845963 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.845966 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.845990 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.848154 (+ 2164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.848628 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.848631 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.848632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.848730 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.849130 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.849135 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.849136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.849317 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.849459 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.849773 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.849880 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":149,"threads_started":1}
I20260809 02:30:30.851106 23487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:30:30.853384 23362 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } attempt: 3
I20260809 02:30:30.853874 23235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710: Bootstrap starting.
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.188@KRBTEST.COM for kudu/127.21.214.189@KRBTEST.COM
I20260809 02:30:30.857503 23235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710: Neither blocks nor log segments found. Creating new log.
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.190@KRBTEST.COM
I20260809 02:30:30.858839 23235 log.cc:824] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710: Log is configured to *not* fsync() on all Append() calls
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.189@KRBTEST.COM for kudu/127.21.214.188@KRBTEST.COM
I20260809 02:30:30.862702 23235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710: No bootstrap required, opened a new log
I20260809 02:30:30.862856 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.852029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36618 (local address 127.21.214.189:44279)
0809 02:30:30.852144 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.852149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.852161 (+ 12us) server_negotiation.cc:407] Connection header received
0809 02:30:30.852205 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.852208 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.852255 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.852341 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.852853 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.853605 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.855268 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.855628 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.855761 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.858689 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.858696 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.858700 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.858741 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.860760 (+ 2019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.861283 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.861287 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.861289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.861385 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.861712 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.861716 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.861717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.862021 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.862096 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.862533 (+ 437us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.862680 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 02:30:30.862942 23239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.850546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55464 (local address 127.21.214.190:44595)
0809 02:30:30.851267 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.851271 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.851284 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:30:30.851313 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.851316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.851354 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.851435 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.852227 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.852973 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.854244 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.854605 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.854694 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.858988 (+ 4294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.858995 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.858999 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.859047 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.860937 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.861444 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.861449 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.861451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.861536 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.861890 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.861894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.861896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.862101 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.862261 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.862678 (+ 417us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.862797 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654}
I20260809 02:30:30.863411 23492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.851747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.189:44279 (local address 127.0.0.1:36618)
0809 02:30:30.851904 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.851919 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:30.851996 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:30.852380 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:30.852383 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:30.852551 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:30.852651 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.852658 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.854292 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.854296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.855123 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.855138 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.855778 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.855781 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.855873 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.856356 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:30.856371 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:30.858523 (+ 2152us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:30.860890 (+ 2367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.860894 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.860897 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.861154 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.861499 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.861504 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.861506 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.861599 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.862178 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:30.862181 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:30.862296 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 02:30:30.863069 (+ 773us) client_negotiation.cc:240] Negotiation successful
0809 02:30:30.863209 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":31}
I20260809 02:30:30.863713 23367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.853907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47386)
0809 02:30:30.854083 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.854097 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:30.854172 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:30.854430 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:30.854434 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:30.854621 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:30.854725 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.854732 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.855819 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.855823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.856731 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.856743 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.857317 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.857321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.857414 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.857878 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:30.857890 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:30.859354 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:30.862044 (+ 2690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.862047 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.862049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.862298 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.862652 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.862655 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.862657 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.862766 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.863235 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:30.863238 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:30.863330 (+ 92us) client_negotiation.cc:769] Sending connection context
0809 02:30:30.863408 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 02:30:30.863554 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111}
I20260809 02:30:30.864145 23487 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } has no permanent_uuid. Determining permanent_uuid...
I20260809 02:30:30.864610 23494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.853989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47386 (local address 127.21.214.188:44167)
0809 02:30:30.854147 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.854153 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.854179 (+ 26us) server_negotiation.cc:407] Connection header received
0809 02:30:30.854243 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.854246 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.854286 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.854836 (+ 550us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.854920 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.855702 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.856896 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.857188 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.857312 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.859910 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.859920 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.859925 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.859955 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.861911 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.862451 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.862454 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.862456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.862539 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.862894 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.862896 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.862898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.863126 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.864229 (+ 1103us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.864305 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.864420 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":87}
I20260809 02:30:30.867875 23362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245: Bootstrap starting.
I20260809 02:30:30.867822 23235 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } }
I20260809 02:30:30.868064 23235 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9ac850678314b0fbfb09915980be710, State: Initialized, Role: FOLLOWER
I20260809 02:30:30.868409 23235 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } }
I20260809 02:30:30.870482 23235 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [sys.catalog]: configured and running, proceeding with master startup.
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, kudu/127.21.214.188@KRBTEST.COM for kudu/127.21.214.188@KRBTEST.COM
I20260809 02:30:30.870944 23362 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245: Neither blocks nor log segments found. Creating new log.
Aug 09 02:30:30 dist-test-slave-68xk krb5kdc[23096](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786242630, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.21.214.189@KRBTEST.COM
I20260809 02:30:30.871927 23362 log.cc:824] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245: Log is configured to *not* fsync() on all Append() calls
I20260809 02:30:30.874398 23362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245: No bootstrap required, opened a new log
I20260809 02:30:30.874984 23490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.865282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47392 (local address 127.21.214.188:44167)
0809 02:30:30.865375 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.865379 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.865693 (+ 314us) server_negotiation.cc:407] Connection header received
0809 02:30:30.865827 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.865829 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.865864 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.865913 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.866484 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.867329 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.868372 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.868713 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.868784 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.871296 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.871300 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.871303 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.871327 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.872998 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.873538 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.873542 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.873543 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.873629 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.873934 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.873937 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.873939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.874152 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.874226 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.874658 (+ 432us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.874809 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 02:30:30.875641 23492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.864856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.21.214.188:44167 (local address 127.0.0.1:47392)
0809 02:30:30.865637 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0809 02:30:30.865652 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 02:30:30.865739 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 02:30:30.866026 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 02:30:30.866029 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 02:30:30.866200 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0809 02:30:30.866324 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.866333 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.867449 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.867454 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.868255 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 02:30:30.868267 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.868905 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.868908 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 02:30:30.868977 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.869476 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 02:30:30.869492 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 02:30:30.871135 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 02:30:30.873109 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.873115 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.873120 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.873413 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.873746 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 02:30:30.873749 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 02:30:30.873754 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 02:30:30.873840 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 02:30:30.874287 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 02:30:30.874291 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 02:30:30.874389 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 02:30:30.875326 (+ 937us) client_negotiation.cc:240] Negotiation successful
0809 02:30:30.875472 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":125,"threads_started":1}
I20260809 02:30:30.876849 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.865391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36620 (local address 127.21.214.189:44279)
0809 02:30:30.865502 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.865506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.865519 (+ 13us) server_negotiation.cc:407] Connection header received
0809 02:30:30.865678 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.865684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.865746 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.865799 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.866705 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.867429 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.868752 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.869106 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.869193 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.872523 (+ 3330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.872530 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.872535 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.872564 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.874268 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.874819 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.874823 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.874825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.874904 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.875328 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.875333 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.875335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.875549 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.875745 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.876552 (+ 807us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.876694 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:30:30.879220 23487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8: Bootstrap starting.
I20260809 02:30:30.879166 23362 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } }
I20260809 02:30:30.879456 23362 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34caf53f93fa4144af4bf57106193245, State: Initialized, Role: FOLLOWER
I20260809 02:30:30.879916 23362 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } }
I20260809 02:30:30.880486 23520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } } }
I20260809 02:30:30.880749 23520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:30:30.876942 23118 master_runner.cc:186] Error getting master registration for 127.21.214.189:44279: OK, instance_id { permanent_uuid: "34caf53f93fa4144af4bf57106193245" instance_seqno: 1786242630597310 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:30:30.881433 23362 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:30.881472 23118 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:30:30.881909 23487 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8: Neither blocks nor log segments found. Creating new log.
I20260809 02:30:30.882846 23487 log.cc:824] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8: Log is configured to *not* fsync() on all Append() calls
W20260809 02:30:30.885954 23517 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:30:30.886041 23517 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:30:30.886502 23500 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } } }
I20260809 02:30:30.886631 23500 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:30:30.886794 23487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8: No bootstrap required, opened a new log
I20260809 02:30:30.887050 22362 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 02:30:30.888579 23189 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "e9ac850678314b0fbfb09915980be710"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55464
I20260809 02:30:30.888823 23189 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 02:30:30.888994 23189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:30.890522 23189 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } }
I20260809 02:30:30.891778 23487 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } }
I20260809 02:30:30.891976 23317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9ac850678314b0fbfb09915980be710" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "34caf53f93fa4144af4bf57106193245"
I20260809 02:30:30.892081 23487 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9865d382654b40bcb26239fbe19463c8, State: Initialized, Role: FOLLOWER
I20260809 02:30:30.892230 23317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245 [term 0 FOLLOWER]: Advancing to term 1
I20260809 02:30:30.892454 23487 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } }
I20260809 02:30:30.889816 23246 master_runner.cc:186] Error getting master registration for 127.21.214.188:44167: OK, instance_id { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" instance_seqno: 1786242630823276 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 02:30:30.893682 23317 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9ac850678314b0fbfb09915980be710 in term 1.
I20260809 02:30:30.893761 23246 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 02:30:30.893874 23487 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 02:30:30.894057 23189 leader_election.cc:288] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [CANDIDATE]: Term 1 election: Requested vote from peers 34caf53f93fa4144af4bf57106193245 (127.21.214.189:44279), 9865d382654b40bcb26239fbe19463c8 (127.21.214.188:44167)
I20260809 02:30:30.894126 23141 leader_election.cc:302] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34caf53f93fa4144af4bf57106193245, e9ac850678314b0fbfb09915980be710; no voters:
I20260809 02:30:30.894477 23500 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 02:30:30.894745 23500 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [term 1 LEADER]: Becoming Leader. State: Replica: e9ac850678314b0fbfb09915980be710, State: Running, Role: LEADER
I20260809 02:30:30.895121 23500 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } }
I20260809 02:30:30.894980 23442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9ac850678314b0fbfb09915980be710" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9865d382654b40bcb26239fbe19463c8"
I20260809 02:30:30.895780 23442 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8 [term 0 FOLLOWER]: Advancing to term 1
W20260809 02:30:30.896687 23537 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260809 02:30:30.897274 23442 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9ac850678314b0fbfb09915980be710 in term 1.
I20260809 02:30:30.897292 23500 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9ac850678314b0fbfb09915980be710. Latest consensus state: current_term: 1 leader_uuid: "e9ac850678314b0fbfb09915980be710" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } } }
I20260809 02:30:30.897401 23500 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [sys.catalog]: This master's current role is: LEADER
W20260809 02:30:30.901548 23537 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:30:30.904449 23541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } } }
I20260809 02:30:30.904616 23541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:30:30.908057 23552 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 02:30:30.909322 23552 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 02:30:30.909770 23239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.896609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55480 (local address 127.21.214.190:44595)
0809 02:30:30.896735 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.896740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.898086 (+ 1346us) server_negotiation.cc:407] Connection header received
0809 02:30:30.898309 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.898314 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.898380 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.898466 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.899655 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.900509 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.901988 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.902376 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.902493 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.905615 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.905620 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.905623 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.905652 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.907640 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.908238 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.908242 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.908244 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.908336 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.908683 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.908686 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.908688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.908931 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.909044 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.909483 (+ 439us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.909610 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 02:30:30.913012 23490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.897379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47402 (local address 127.21.214.188:44167)
0809 02:30:30.897496 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.897503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.902090 (+ 4587us) server_negotiation.cc:407] Connection header received
0809 02:30:30.902260 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.902264 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.902314 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.902370 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.904303 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.905091 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.906307 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.907509 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.907587 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.909320 (+ 1733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.909324 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.909326 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.909353 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.911146 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.911674 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.911678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.911679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.911766 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.912056 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.912059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.912061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.912276 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.912392 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.912731 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.912853 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 02:30:30.920341 23442 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8 [term 1 FOLLOWER]: Refusing update from remote peer e9ac850678314b0fbfb09915980be710: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:30:30.920428 23317 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245 [term 1 FOLLOWER]: Refusing update from remote peer e9ac850678314b0fbfb09915980be710: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 02:30:30.920994 23500 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:30:30.921187 23544 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 02:30:30.924969 23520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9ac850678314b0fbfb09915980be710. Latest consensus state: current_term: 1 leader_uuid: "e9ac850678314b0fbfb09915980be710" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } } }
I20260809 02:30:30.925211 23520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:30:30.925489 23541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9ac850678314b0fbfb09915980be710. Latest consensus state: current_term: 1 leader_uuid: "e9ac850678314b0fbfb09915980be710" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } } }
I20260809 02:30:30.925622 23541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 02:30:30.926715 23571 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 02:30:30.926807 23571 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 02:30:30.927536 23373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:30.898173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36624 (local address 127.21.214.189:44279)
0809 02:30:30.898327 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:30.898332 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:30.911601 (+ 13269us) server_negotiation.cc:407] Connection header received
0809 02:30:30.911805 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:30.911808 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:30.911866 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:30.911925 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:30.912795 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.913658 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.914971 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:30.915319 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:30.915432 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:30.917304 (+ 1872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 02:30:30.917311 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 02:30:30.917316 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 02:30:30.917347 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 02:30:30.919134 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.925884 (+ 6750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.925888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.925890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.925990 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 02:30:30.926381 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 02:30:30.926385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 02:30:30.926386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 02:30:30.926655 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 02:30:30.926786 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:30.927201 (+ 415us) server_negotiation.cc:299] Negotiation successful
0809 02:30:30.927335 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 02:30:30.935827 23544 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9ac850678314b0fbfb09915980be710" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } } }
I20260809 02:30:30.935985 23544 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:30.937325 23552 catalog_manager.cc:1347] Generated new cluster ID: 8ac75d7a5e3e45a9beae73239b317ebc
I20260809 02:30:30.937395 23552 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 02:30:30.937299 23520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9ac850678314b0fbfb09915980be710" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } } }
I20260809 02:30:30.937431 23520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:30:30.938050 23578 mvcc.cc:205] Tried to move back new op lower bound from 7316449816239702016 to 7316449816151064576. Current Snapshot: MvccSnapshot[applied={T|T < 7316449816239702016}]
I20260809 02:30:30.946147 23500 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9ac850678314b0fbfb09915980be710" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } } }
I20260809 02:30:30.946300 23500 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710 [sys.catalog]: This master's current role is: LEADER
I20260809 02:30:30.947490 23541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9ac850678314b0fbfb09915980be710" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ac850678314b0fbfb09915980be710" member_type: VOTER last_known_addr { host: "127.21.214.190" port: 44595 } } peers { permanent_uuid: "34caf53f93fa4144af4bf57106193245" member_type: VOTER last_known_addr { host: "127.21.214.189" port: 44279 } } peers { permanent_uuid: "9865d382654b40bcb26239fbe19463c8" member_type: VOTER last_known_addr { host: "127.21.214.188" port: 44167 } } }
I20260809 02:30:30.947638 23541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 02:30:30.948177 23577 mvcc.cc:205] Tried to move back new op lower bound from 7316449816239702016 to 7316449816151064576. Current Snapshot: MvccSnapshot[applied={T|T < 7316449816239702016}]
I20260809 02:30:30.974866 23552 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 02:30:30.977741 23552 catalog_manager.cc:1504] Loading token signing keys...
I20260809 02:30:30.995321 23552 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9ac850678314b0fbfb09915980be710: Generated new TSK 0
I20260809 02:30:31.000048 23552 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 02:30:31.040645 23239 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:31.038140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55494 (local address 127.21.214.190:44595)
0809 02:30:31.038268 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:31.038272 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:31.039512 (+ 1240us) server_negotiation.cc:407] Connection header received
0809 02:30:31.039766 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:31.039771 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:31.039824 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:31.039877 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:31.040517 (+ 640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55494: BlockingRecv error: recv got EOF from 127.0.0.1:55494 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 02:30:31.042078 23490 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:31.038930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47412 (local address 127.21.214.188:44167)
0809 02:30:31.039045 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:31.039049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:31.041144 (+ 2095us) server_negotiation.cc:407] Connection header received
0809 02:30:31.041319 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:31.041322 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:31.041370 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:31.041419 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:31.041951 (+ 532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47412: BlockingRecv error: recv got EOF from 127.0.0.1:47412 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260809 02:30:31.044253 23373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:31.042865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36630 (local address 127.21.214.189:44279)
0809 02:30:31.042981 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:31.042986 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:31.043241 (+ 255us) server_negotiation.cc:407] Connection header received
0809 02:30:31.043497 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:31.043500 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:31.043549 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:31.043600 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:31.044135 (+ 535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36630: BlockingRecv error: recv got EOF from 127.0.0.1:36630 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 02:30:31.048760 23373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:31.047180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36642 (local address 127.21.214.189:44279)
0809 02:30:31.047282 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:31.047287 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:31.047796 (+ 509us) server_negotiation.cc:407] Connection header received
0809 02:30:31.048008 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:31.048012 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:31.048085 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:31.048139 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:31.048648 (+ 509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36642: BlockingRecv error: recv got EOF from 127.0.0.1:36642 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260809 02:30:31.055716 23373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:31.052417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36656 (local address 127.21.214.189:44279)
0809 02:30:31.052515 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:31.052518 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:31.054828 (+ 2310us) server_negotiation.cc:407] Connection header received
0809 02:30:31.055010 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:31.055013 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:31.055064 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:31.055114 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:31.055601 (+ 487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36656: BlockingRecv error: recv got EOF from 127.0.0.1:36656 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260809 02:30:31.063011 23373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:31.060060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36664 (local address 127.21.214.189:44279)
0809 02:30:31.060153 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:31.060157 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:31.062045 (+ 1888us) server_negotiation.cc:407] Connection header received
0809 02:30:31.062226 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:31.062229 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:31.062281 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:31.062332 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:31.062912 (+ 580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36664: BlockingRecv error: recv got EOF from 127.0.0.1:36664 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 02:30:31.071646 23373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:31.070108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36676 (local address 127.21.214.189:44279)
0809 02:30:31.070235 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:31.070239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:31.070742 (+ 503us) server_negotiation.cc:407] Connection header received
0809 02:30:31.070923 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:31.070926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:31.070975 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:31.071039 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:31.071550 (+ 511us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36676: BlockingRecv error: recv got EOF from 127.0.0.1:36676 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 02:30:31.083683 23373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:31.081978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36684 (local address 127.21.214.189:44279)
0809 02:30:31.082087 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:31.082091 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:31.082718 (+ 627us) server_negotiation.cc:407] Connection header received
0809 02:30:31.082925 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:31.082928 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:31.082980 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:31.083035 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:31.083562 (+ 527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36684: BlockingRecv error: recv got EOF from 127.0.0.1:36684 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260809 02:30:31.104617 23373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:31.102757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36686 (local address 127.21.214.189:44279)
0809 02:30:31.102891 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:31.102896 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:31.103504 (+ 608us) server_negotiation.cc:407] Connection header received
0809 02:30:31.103758 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:31.103761 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:31.103822 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:31.103882 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:31.104490 (+ 608us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36686: BlockingRecv error: recv got EOF from 127.0.0.1:36686 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 02:30:31.140848 23373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:31.139590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36690 (local address 127.21.214.189:44279)
0809 02:30:31.139785 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:31.139790 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:31.139912 (+ 122us) server_negotiation.cc:407] Connection header received
0809 02:30:31.140022 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:31.140025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:31.140074 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:31.140149 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:31.140720 (+ 571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36690: BlockingRecv error: recv got EOF from 127.0.0.1:36690 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
W20260809 02:30:31.208653 23373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:31.207267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36702 (local address 127.21.214.189:44279)
0809 02:30:31.207444 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:31.207450 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:31.207680 (+ 230us) server_negotiation.cc:407] Connection header received
0809 02:30:31.207829 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:31.207832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:31.207885 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:31.207960 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:31.208519 (+ 559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36702: BlockingRecv error: recv got EOF from 127.0.0.1:36702 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260809 02:30:31.340615 23373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:31.339318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36708 (local address 127.21.214.189:44279)
0809 02:30:31.339475 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:31.339481 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:31.339574 (+ 93us) server_negotiation.cc:407] Connection header received
0809 02:30:31.339793 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:31.339799 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:31.339875 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:31.339970 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:31.340478 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36708: BlockingRecv error: recv got EOF from 127.0.0.1:36708 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260809 02:30:31.600472 23373 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 02:30:31.599159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46488 (local address 127.21.214.189:44279)
0809 02:30:31.599407 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:31.599413 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:31.599526 (+ 113us) server_negotiation.cc:407] Connection header received
0809 02:30:31.599655 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:31.599658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:31.599724 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:31.599821 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 02:30:31.600375 (+ 554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46488: BlockingRecv error: recv got EOF from 127.0.0.1:46488 (error 108)
Metrics: {"server-negotiator.queue_time_us":152}
I20260809 02:30:31.903208 23537 catalog_manager.cc:1259] Loaded cluster ID: 8ac75d7a5e3e45a9beae73239b317ebc
I20260809 02:30:31.903301 23537 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245: loading cluster ID for follower catalog manager: success
I20260809 02:30:31.905109 23537 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245: acquiring CA information for follower catalog manager: success
I20260809 02:30:31.906314 23537 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 34caf53f93fa4144af4bf57106193245: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:30:31.928083 23571 catalog_manager.cc:1259] Loaded cluster ID: 8ac75d7a5e3e45a9beae73239b317ebc
I20260809 02:30:31.928171 23571 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8: loading cluster ID for follower catalog manager: success
I20260809 02:30:31.930048 23571 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8: acquiring CA information for follower catalog manager: success
I20260809 02:30:31.931308 23571 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9865d382654b40bcb26239fbe19463c8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 02:30:32.119254 23694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:32.114755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46502 (local address 127.21.214.189:44279)
0809 02:30:32.115052 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:32.115056 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:32.115206 (+ 150us) server_negotiation.cc:407] Connection header received
0809 02:30:32.115282 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:32.115285 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:32.115428 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:32.115544 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:30:32.115814 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:32.116395 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:32.117370 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:32.117624 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:32.117736 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:32.118118 (+ 382us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:30:32.118698 (+ 580us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:30:32.118808 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:32.118928 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 02:30:32.118987 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":87,"threads_started":1}
I20260809 02:30:32.126361 23701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:32.122622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47268 (local address 127.21.214.188:44167)
0809 02:30:32.122862 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:32.122865 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:32.122880 (+ 15us) server_negotiation.cc:407] Connection header received
0809 02:30:32.123048 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:32.123050 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:32.123222 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:32.123323 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:30:32.123572 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:32.124073 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:32.124917 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:32.125196 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:32.125279 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:32.125571 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:30:32.125959 (+ 388us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:30:32.126059 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:32.126193 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 02:30:32.126242 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":90,"threads_started":1}
I20260809 02:30:32.134543 23701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:32.130076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47280 (local address 127.21.214.188:44167)
0809 02:30:32.130202 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:32.130209 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:32.130579 (+ 370us) server_negotiation.cc:407] Connection header received
0809 02:30:32.130671 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:32.130674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:32.130743 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:32.130830 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:30:32.131142 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:32.131894 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:32.133081 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:32.133403 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:32.133495 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:32.133937 (+ 442us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:30:32.134019 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:30:32.134080 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:32.134258 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 02:30:32.134327 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 02:30:32.134609 23713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:32.129694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52954 (local address 127.21.214.190:44595)
0809 02:30:32.129961 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:32.129964 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:32.130056 (+ 92us) server_negotiation.cc:407] Connection header received
0809 02:30:32.130448 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:32.130455 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:32.130644 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:32.130770 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:30:32.131228 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:32.132021 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:32.132931 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:32.133281 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:32.133386 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:32.133768 (+ 382us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:30:32.134122 (+ 354us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:30:32.134221 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:32.134374 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 02:30:32.134462 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":94,"threads_started":1}
I20260809 02:30:32.134727 23694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 02:30:32.129661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46508 (local address 127.21.214.189:44279)
0809 02:30:32.129802 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 02:30:32.129808 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 02:30:32.130263 (+ 455us) server_negotiation.cc:407] Connection header received
0809 02:30:32.130486 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 02:30:32.130490 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 02:30:32.130567 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 02:30:32.130643 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 02:30:32.130998 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:32.131662 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:32.133046 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 02:30:32.133362 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 02:30:32.133449 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 02:30:32.134142 (+ 693us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 02:30:32.134250 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 02:30:32.134324 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 02:30:32.134530 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 02:30:32.134586 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 02:30:32.138491 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 23118
I20260809 02:30:32.154567 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 23246
I20260809 02:30:32.166658 22362 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskplQfV_/build/debug/bin/kudu with pid 23377
2026-08-09T02:30:32Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3441 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6852 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (303892 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST